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public » opinion polling, and interactive pfcogramingi The second 
. section' defines these applications, descri^bes them in terms of their 
^ uses and operational limitations, and of fers. exam^pies of how each 
applicatio'h could be implemented.' Th§ third section .^of the report 
•^overs the cost, limitations, an4 ap^ropriatene;^s ,of each' of the 
'possible applica;tions, vliile 'the ' fourth . section discusses the general 
barriers to the use of -th^ systems. The fifth secti^on compares each 
.system to convejit^onal^feddback methods and to its competitors, and 
the sixth section; notifcs ttf^ best technologies suited for each^ . 
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PREFACE ^ 



Within the emerging "new technologies" environment, fore- 
sighted ^lanry^nq of optimal roles for public television 
requires eyeful surV'feil lance of the telecommunications 
horizon. New communication channels ^nd new content 
possibilities within those channels are already presenting 
our industry with d^ci^ting challenges and opportunities. 

\ The follow4ng paper was commissioned by ther Of f ice' of 
Communication. Research to survey the currejjt and near- 
future telecomjnunications tiniverse and to suggest potential 
appl^icatioris of new developments both for audience res^^rch 
and program production. ^ The' result of the authors' overview 
is an intriguing menu of new audience feedback possibilities. 
It is our hope that the dissemination of these findings will 
encourage innovative approaches in the development and 
evaluation of new p^rogramming material. » 



Howard A. My rick, Ph.Dv 
Director 

.Office of ^ Communication 
Research 



Caro^^ Keegan , Ph . D . , 
Associate Director 
Office of Communication, 
Research , 
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INTRODUCTION 



The Problem 



Many of the "blue sky" interactive residential services pop- 

ularized during the early 1970s are now becoming a-, reality 

throWhvthe marriage of computer and telecommunications tech- 

nologies* A variety of information and transaction services 

are already av^lable which individuals can access in their 

homes by cohnecting to computer-based systems via cable or 
<^ • 

telephone networks. These services include .shopping , banking, 
informatio^ retrieval and entertainment. 

For television broadcasters, these very same te'chnblogies hold 
the potential for^dramaticafly changing the traditional models 
of programming and audience research. They offer channels 
through which viewers can respond to^;f:elevision programs and 
convey their opinions and attitudete to the broadcaster almost 
instantaneously, thus allowing' view.ers to '"t^k back to their 

TV sej:s." Audience feedback systems will enable viewers to 
express their opinions about the jprograms they view and even 

allow them to.be active particioants in the program itself. 

« * . • * 

Such capabilities may even alter the basic nature of television 

viewing," transforming it ^f rom a passive to an active experience 



Electronic audience feedback systems haVvS much' to offer public 

' ' ' ' * <j . . ■ 

television stations. ^ These technologies can give lo,cal stations 

tools by. which they can become more resj^onsive bo the needs and 

y ' 

interests of speciali"^^(r~a\jidi^nces and continue to develop 

■V/ - 

innovative programm-ing concepts*. This kind of capability, is 



especially needed at time when public television i/ being 
confronted by competition from c^bmmercial iokterests who-are^ . 
entering into programming areas whifih were previously the sol^ 
purview of public tele^sion. The 'Office of Communication 
Research at tji^^orporation for Public Broadcasting (CPB) 
commissioned th'is pdper as part of its continuing commitment to 
exploring innovative research methods of use to public broad- 
casting » "Its pur^se is to identify promising technologies that 
could meet the special' needs of public broadcasters. In par- 
ticular, we will explor.e the possibility that audience feedback 
systems could reduce the cost and 'labor of eliciting viewer^ 
opinions and attitudes to a level which could be; readily af- 
forded by" lotal public television entities. ^ - 



- , • ■ / ■ • ' 3 

B, Approach , ' ' ^ c * 

Audience feedback systems areydefined in this report as technical 
configurations which' allow viewers to res^nd electronically to 

television programming via telecommunications networks. The 

• • \ 

report' is limited to those systenjs which are, -or are soon to 

be, marketed by commercial venders^ and are accessible for use by 
any public television entity. In addition^ the sys*tems must 
allow' viewers\j:o respond to the video materials from . the natural 
viewing environment, in the home^ ^ 

Audience feedback systems were identified by reviewing com- 
munications and marketin<j^ research publicati'ons and by ^contact- 
irig research practitioners in those industries. Announcements 
were placed in leading trade journals to solicit information 
^ou€ relevant systems. The marketers of the various identified 
systems were then contacted and intervi^'ed in person or via ' 
telephone. : ' . . 
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C> Overview of This Report ; 

This report begins by specifying four app,lications in 
which audience feedback systems could benefit publxc 
television organizations. They are pretesting, qualitative 

.ratings, public opinion polling and' interactive programming. 
These applications were formulated, based upon two conferenc"^ 
sponsored by the Corporation for Public Broadcasting (CPB, 1980a; 
1980b) and the authors' own experiences working for local 
public •tele\>ision stations. These applications are defined in , 
Section II of this report and are described in terms of their 

, uses and operational parameters. Prototypical examples of how 
each application could be implemented with an felectronic \^ 
audience feedback system a^re also^ of feared. ^ . . 

^The operationaT description of the systems and their cost, 
** ' * 

limitations, and appropriateness for each %)f the identified 

' • . ' " ^ ^ . 

applications are covered *in Section III. Some of the ^general^t 

barrierjs to 'utilizing audience feedback ^systems are discussed' 
ip Sect/ion IV ..based upon a demonstration of one of the iden-y 
tif ie<3 5ystems\ * Each of the recommended systems is analyzed 
in Section V against conventional >methods and against its com- 
petitors. Particular attention is paid to the relative cost - - 
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advantages of the different systems. Based upon the analysis 
of the operational characteristics/ we identify 'the tech- 
nologies best suited for each application in Section VI. 
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II ♦ apPlica'tons 

Pretesting 

Definition . Pretesting is research conducted to determine the 
potential audience response prior to the broadcast of a tele- 
vision program. Such formative research assists/decision makers^ 
in approaching questions ofi conceptualization, development, ' 
scheduling, and^ promotion of a television program. Pretesting^ 
is us,ually conducted on one or more pilot programs, although stoiry- 
boards, scripts, treatments, or concepts, may also be tested • A 
closely related application is diagnostic testing of program? 
already on the air for the purposes of assessing changes, in program 

content, promotion, or scheduling that could improve appeal or 

« 

effectiveness* ' * - * , 

Uses , . The principal clients for this type of research are pro- 
gram producers who want to insure that their message is effectively 
conveyed to the target audience. , By pretesting pilot program.- 
ming with saittples of potential viewers, audience response to - 
the pr.ogram (e.g. appeal, comprehension, and acquisition of*- - 
desired knowledge /attitudes) and its particular attributes (e.g., 
cast, theme, sfettingv and style) can be ^valuated and fed back 
into the production process. Pretesting is also of value to 
other program' decision makers who fac3(p decisions relating to 
funding, scheduling, and* promotion . The commercial sector 
utilizes pretesting extensively , to help decide which tele- 
^vision pilots and commercials should go on the -air. 



Pretesting has also beei> used extensively within p.ublic broad- ' 

* " • *i 

casting in support of children's programming and, to a lesiser ^ 

(extepft/ for* adult programming* However, pretesting is by no 

• * . » • * 

means as commonly used within public broadcasting as it is in 

**<■'. ' ' ^ • • 

the private s'ector. Local public television productions ^in . 
particular ^ldom.,have the benefit of pretesting. The cost of' 
pretesting and/or -the unavailability of pretexting . skills ^t the 
local 'level are important barriers/ Public broadcasters serve 
specialized target audiences that are poorly represented in the 
g*eneral audience samples recruited by- commercial testing ser- 
vices.' The recri^y:ment /of specialised audiences can make such 
services prohibitively^expeJisive. Impending budget cuts in ' ♦ ■ 
t4x-su^ported programs, for children (e.g., ESAA dnd other ' \ 
Department of Education programs) portend- ap era 'o£. less ,^ not 
more, pretesting .iji. public broadcasting 'generally . , V ^ v 

« * » r , 

• • • I * 

This is uhfortunate. since pretesting could be more fuJU^ utilized 

* * N 

within public t^elfevision to assist the CPB Pfoqram Fund Director, 
potential 'underwriters , and program' consortia in determining which 
programs should be suppor.ted. Such findings could also be Qse- 
ful to' local stations ^when .they plan -programs, schedules and 
* promo^tion/strategi^s ,^ oi?, when they , present their "case'*>^or 
^Dcal productions at the program 'cooperative meetings. • . ' 

Parameters. Pretesting or df'iagnostic testing require the col- 



lection of a relatively large quantity of dat^ pertaining tosa 
^ngle program. Continuous ratings of appeal are often collected 
during viewing in order to determine viewer response to each 
segment ami thereby identify* the successful componentte^ 

* -4. JL * •» 



of the show. A variety of program analyzer techaiques and ob- 
servational measures are currently used for this purpose, 
^Rather lengthy questionnaires ^re also us'ed to obtain the social 
.and viewing characteristics of viewers, overall ratings of 
appeal, evaluations of specif ic program components (e,g,, char^ 
acters, themes,- and settii|Ks) and other relevant dimensions 
(e.g, , .viewing intentj.ons, image analyses). Open-ended responses 
to program content may also be elicited through 'questionnaires 
or focus group sessions, either in con j unction\with the, closed- 
ended qijesUons or in lieu of them. Public broadcasting -pro- 
grams iiitpose additional data collection requirements .yjhen ' - - ' 
,audieiice outcome objec^tives, .^s well^as program appeal , must be 
measured. ^ , ' 



Quick turnaround i^ extremely important <5)wing to the necessity 
- ' of .keeping up with tight product^ion schedules'. Preliminary 
data must .sietimes b^ available overnight and . final tesults 
must be c/mpletec! within a few Says at most-. 

A serious t>robl^p(i in pretesting is l>0w to get the 'test pro- • 
grafti to the respondents. The conventional. methc5d is to invite* 
respondents to attend a. showing at a central viewing auditorium, 
"e.g., A'udient;e Studies, '?nc^. ' s Preview House.. However, this 
arrangement, has little • external validity ^nd • imposes aeon- 
siderab'ie burden .on~-c«spondents ,^.?specially in an era of rising 
transportation- costs,'- in "order 'to test programming in a more 
natural environment, sQme^ commercial organizations^ (e.g.,. Audi- 
. ence Studies,. Inc.,' Burke Marketing Services, ands Blumenthal 
O Research Strategies, Inc.) utilize -cable systems for 'transmitting 

ERIC - * a . t 



"pilots, and viewers* responsess are collected thorough diaries and/o 
subsequent telephone interviews • Public broadcasters do h^ve 
the option of broadcasting a pilot, a practice which is an un- 
acceptable security risk in tjie highly .competitive world of 
corahercial jDroadcasting • .However, the logistics of data col- 
lection from the home using conventional methods lengthen the 

'turnaround time considerably — or -increase the cost/ 

o* ' . * 

In order' to meet these essential- requirements at an affordable 
cost, sacrifices are often made regarding the quality and size 
of the sample. It is 'common practice to utilize quota samples 
of a targ'et audience, usually ^-not selected on a purely random 
basis, and sample size^ 6f;io^iy a couple hundred. Resg)onse rates 
of only 10 or*20 percent are accepted in order to reduce the 
lead* times *and costs associated with recruiting. Tests are 
often conducted in one or two of the. major markets and -thus 
fail t^ represent truly the audiences of local broadcasters. 



»To compensate for the nonrandomness of the sample, research 
'o4:ganizatio|is resort to the use of norms which tell them how a 
progjram compares to other simi-lar programs rated by audiences 
recruited by identical (if nonrandom) means. Pret'es^ting for 
public broadca^sting poses a special problem in this respect 
since highly segmented and -varying target audiences, rather than 
the^ general viewing audience, are of interest. This factor 
c^an add greatly to the cost of research and frequently invali- 
dates^ the norms that are the key to interpreting the data 
gathered by commercial research s.ervices. 

13 



Prototype Example. A prototypical pretest invoiving^ interactive 
technol^ogies might entail collecting program analyzer and ques*tion~ 
nai're d^ta from 400 people in a single local market. We will 
assume that the program is 30 minutes long and that continuous ' 
ratings are made every' minute, TShe salient attributes ^of the 
program would be rated after viewing, aAdthe audience's com- 
prehension of the program's salient points would be^assess'ed • Open-- 

< 

ended responses would als.o be elicited from ^20 'percent of the . sample 
who had the strongest reactions (positive or negative) to the 
program, Basici demographic and viewing characteristics would 
also be specified. A total of 60 columns of data would be 
g'^^^^^^Jied from each subject. The sample would be recruited 
A. on 'a quota- samp Ivmg basis from, an expanded telephone frame »to 
include PBS viewers^ and representatives of special target 
audiences. ' Respondents would be invited to vxew the test pro- 
gram in their homes via open-broadcast. Initial |^es^ults would 
be available to the, local .s4:ation .that commissioned it on an 
overnight l^sis with $n in-depth report completed within ten 
-\vorking days, ^ _ * - * 
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B. Qualitative Ratings ^ 

Definition . Most on-going evaluations of television programming * 
aire quantitative in nature, stressing the measurement of audience 
J >size, e.g., the, Nielsen ratings. Such measurements serve the 

purposes of the commercial broadcas^ters 'whose objectives are 
to attract the largest possible audience for their advertising 
clients. Quantitative ratings are the primary datum of the , 
broadcast industry^. They are\used-to frame .the full "range of 
decisions involving programs.^' scheduling , and p^romotion. On 
the other -hand, pub;Lic television sarves 'many small and 
specialized groups which exist withi'n a community whose inter- 
ests are not otherwise met. -In this perspective, public tele- 
^vision shoi^ld not be judged solely on the basis of audience size, 
•. but by the degree to which these specialized viewers and their 
interests are. served. Public broadcafeters are more concerned • 
wi^th the public's qualitative ratings G-^-programming . That is, 
they jie^d to know how specialized audiences rate programs on 
dimensions 'such as enjoyment, originality, commlinity serv/fce, 

personal reTevance, etc. , —i---^ .-i 

■ • • " .• 

Uses. The concept, of qualitative ratings and 'their import^e 
to- public television has been extensively discussed in previous 
reports (CPB 1,980a; 1980b). Briefly, it is^intended that 
qualitative ratings will be used"'by pubM^c broadcasting exe- 
■ cutives at, .the national and local levels~ to make decisions about 
the funding, schfedulirvg, and promotion of PBS programs. It is, 
.also hoped 'that, the system will provide an additional dimension 
.of accountability, to both private' and public sector underwriters^ 

ErJc / , .'\ ' ^ ■ 15 
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of public broadcasting. Crude versions of qualitative ratings 
(e-g., TvQ) are already used by commercial broadcasters. 

Parameters . Iji contrast to pretesting, the quality of the sample 
is paramount for qualitative ratings. Since the results are to 
be generalized to all televisi6n viewers, it is important^ that 
the sample be truly representative of the national audience of 
PBS viewers and randomly chosen. A high degree of quality con- s 
trol must be maintained. Respondents must be. identifiable and 
verifiable, and every effort must be made to^ obtain high (50-60 
percent) return rates. Moreover, an extremely, large sample 
(i-.e.", several thousand) is required. Since public television^ * 
attracts^relatively small audiences and is addressed to the needs 
of highly- 'specializbd segfments, the sample must be large; to 



ensure that each program has enough, respondents from each im- 
portant audience segme^ to produce a valid rating for each. 
Participants provide a relatively small number of responses per 
program (i.e., rating each ishow on four or five scales), yet a 



high volume of data would be generated, since many programs would 
be rated each d^y by a large number of respondents. ^Su^ a 
system Would ope'rate on a continuing basis, perhaps with several 
"sweeps" over the course of a ye^ar. It might be operated on a 
panel basis, wifch each respondent staying in the sample for more 
than one sweep • Qualitative ratings do not require fast turn- 
around of results, with a period of days or weeks acceptable. 

Prototype Example > The application, as envisioned in this 
^ report, would consist,. of an on-going system by which samples of 
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television viewers., would evaluate the quality (as' measured on 

» * 
four. or five specific dimensions) of the v,arious^ programs (both 

conunerciaJ.' and public) . they view. Qua ive ratings .would be 

collected from a national stratified sample- of 3,000 households, 

screened for regular PBS viewership and for ^mbership in imp(i^- 

tant demographic (.e.g,, minoritie.^) :^nd interest (e.g,^' opera ^ - 

lovers) groups. All members of ^^^. l^oqsehold would be asked to* 

Participate, and* each household woyJjd stay in the sample for four 

sw^ep periods'* over, the course of the year, generating an average 

of 6,000 columns of data per household per year. Preliminary 

qualitative rating reports would be available within one week 

of each sweep., with fin^al results available inside of tlfPee^ 

weeks , * , . * . • 



( 



17 



15. 



C. Public Opinion Foiling 

Definition , Polls of public 'ppinion are conducted to ascertain 
the state of public ^attitudes toward various issues and .political 
candidates among the general population. 



Uses . Public opinion polling could be used by public television 
stations to identify community needs and to facilitate the dis-*" 
cussion of pubiic issues. One application would be an extension 
of existing j^ommunity ascertainment procedures on which program 
development ^nd policy decisions cpuld be b^sed. Another case\ is 
a program-relat-ed function in which the opinions of a repre- J 
sentative^ sample o'f the community could be used in public affairs 
programming, similar to the telephone "insta-polls" whi.ch many 

'major market commercial stations routinely re^port as pa(rt of 

t . I . - 

their news broadcasts, *tfut conducted while the program is i'n ' 
progress. , ^ ' 

Parameters . Similar to qualitative ratings, the results of * 
public opinion polling are to be generalized to a larger popu- 
lation. Very high standards must be met for sample selection 
and quality control. Biases arising from panel s-hudies which 
might be acceptable for qualitative . ratings do not meet the high 
standards s^t by public opinion pollsters. A large' sample is 
needed, though not as large as for qualitative ratings ^^ince 
the opinions of the general {public more thaa highly speciali^d 

subpopulations , are of inWrest. Sample sizes of 400-1, 100 are 
suitable, depending on the amount of sampling error acceptable. 



The use- of polling in conjunction with a television broadcast 

EMC ■ ^ 18 ' . 
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will pose. some peculiar problems not usually encountered in 
' public dpinion research. The system will have to have a very 
high peak load capacity in order to accommodate a large numbe^ 
of respondents accessing 'it v^ithin a short time frame<* Con- 
trols will have to be exercised to insure that only p^es^slectod, 

^representative respondents are allowed to register trteir 
opinions, and that each responds only once, Othe'rwise,, the 
" results will be useless as a .tool for public debate, ^Though 
dependent on the specific application, quick turnaround of data 
analysis is o^ high importance. If .the' poll is to ocpur during 
a televised program, results will' be needed within minutes, 'or 
at least by the time of tb^ next regularly scheduled broadcast. 
* The system utilized must dlso be "able to provide anonymity in 

,ordpr to protect the ^respondents ' identity When asking sen- 
sitive questions about important social issues. 

Compared to qualitatiye ratings, such polls would require 
the collection of a relatively small amount of data from each 
respondent. The system must be more flexible so that questions 
could be cont.inually ciianged. Respondents would rentain in a 
sample for a limited time^ perhaps only for. a singl^ sLudy. 

Prototype Example > In one application whicji inspited this study 
a local station wani:ed-to participate in its community s goals 
conference. The progr.am concept (which was not implemented) was 
to invite the city fathers to present -and debate/ the various 
V issues facing the community on i television program^, followed by 

a poll of a representative sample of the pommunity to provide 
O immediate feedback' while the program was still in progress. 

ERIC ■. .19, 



within a comiriiinity > 400 po'tentiaL respondents were to be recruited 
in advance from an expanded telephbne frame and agree to view the 
program. The ^sample was -to "provide answe^rs to a few questions 
during the course- of, the pi;ogi;'am at particular po^ts whep ^a 
question ^f^as posed. Results were to available within ten 
minutes to maintain the flow of the program.. " - * 



\ . 
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D. Interactive Prograinming 



Definition. , The g,rowing availability of audience feedl^ack tech- 
nologies offers a variety of intriguing "interactive televisioa" , 
possibilities which will*'allow the responses^of viewers ^to^ become • , 
an integral .patt^ of the programs th^t they watch. In essence, • 
this application transcends the traditional nature ^of tele- 
vision by transforming viewing from a passive to an act;ive ex- 
berience. It differs from the previous (public opinion polling) 
application in trtat the population of interest is^ viewers of a 
particular -pifogr am, rather than the community at large. 

Uses, Possible scenarios -for public bro^casters would include— 
havi*ng the audience dirept improvisational drama, take .^part in ^ 
^ televised town meetings, take' an active part in live-interview 
shows, v6te- for musical selections they would .like, to hear, make 
bids at station auction^, .or provide feedback to instructional > 
id^ lec.tur;^s 



t|levisi6l(p lectur;^s. The limitations of using such a capability 

' .are only that of the proliucer's imaginat^ion". Presently,, the. only 

^ means by^" which such participatory programming cah take -place 

J.S by having viewers call in, but only a few indiyidu'als can 

* r ^ ^ 

have input into "afty one program. « '"^ V 

<- . . , • , 

In such applications, •the ^oal is ^ not to' measure public opinion 
^reliably and validly. as much as it is to, stimulate viewer , 

involvement. Limited experiments in this area indicate that 

. ' * ' . < / • . . . • 

allowing viewers > to inteiLact with, a program does froduc§ in- 
creases in* audience shares j(Media Science Newsletter, 19 80^) . , 

ERIC . ^ - 21 . 



Parameters , The essential characteristics of' the interacti-ve 

programming apolication are quick turnar^oand and the^ ability to 

handle an exceptionally high peak load "trapacity as large numbers 

♦ ^ * 

of viewers try to call j-n at the same time. There is no ideal 
sample size. Rather, the principle %puld b^ "the more the merrie 
In fact, the number of *pj^<^ple calling regularly could become a 
continuing measure of the program*^ popularity • The rfepresen- 
tativeness of the. sample and quality control requirements are 
unimportant. The group which participates (regardless of who, 
they are) is the population of interest. 

■ " ■ ■ ' ' ■ ■ / 

d* / t' 

Prototype Example. A locfal TBS station in a. major market has a 
^ weekly call-in feature (e.g., "Your towfi meeting of the air") 
as part of a local public affairs program.^ A single question 
"would be posed early on in the program which could be answered 
by picking one of two to five alternatives (e.g. "How much 
should^the city council spend on police protection? a. $1 milli 
b. $2 million c. $3 .million d. $4 million e. over-|$10 .million) 
Viewers would jchen have 20'**minutes to phone in their answers. 

Results would be presented before the end. of the program and 
discussed by commentators or panelists. 'On any given week 

approximately 4,000 calls. would be placed. To prevent the 
lines from becoming^ overloaded, ^potential respondents would be 
preselected. They would send in stamped, sel(£:;"addressed post 
cards along with -their request to be included in the town meeting 
panel. clfe'ds wouM be randomly drawn ^nd the- selected respondent 
would be notified of the .call-in number and" their ^ ov^ call''~in 
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time (perhaps scheduled by five-minute periods -after the 
announcement of a question) by return m^ll. Whenever the" numljer 
of 'callers dropped be low '4, 000 for a particular Week, new 
callers would be introduced into the samf^Jfe. give the largest 

possible number of viewers a chance to ^nter' the panel, the , 
call-in numbers coi>ld be ch'anged periodically * and a nevf se|: of 

' ' ■' ' - > -I 

panelist^ drawn. . * ^ > 
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IIJ. Ali^DIENCE FEEDBi»CK SYSTEMS 

- '« . " • 

This section 'provides an overview of a variety of technological 

systems whi.ph could be utilized by local public television 
organizations for^^A^e previously discussed applications • 
Inclusion of potential audiertce feedback systen^ have been re- 
stricted to those systems which are now ^ or soon to be, marketed 
for research purposes and ' available to public broadcasting or- 
ganizations. ^ ^ 

'The systems have been categorized According to two dimensions. 
The first dimensio^^ji^elates to the network configuration upon 
Vhich 'the technologies are ba*sed. There are two principal 
network technologies which are applicable to this assessment- 
of audience feedback systerjs: cable and telephone networks. 
Cable is a broadband technology 'which is utilized to distribute ; 
televisi^ prograjnming ^ to residential subscribers. Whey ■ equipped 
'with the appropriate hardware, cable could allow narx^wband, 
dig4j:al information .to be transmitted frqm homes to a central' 
canputer located at the cable system's headend-. The telephone 
system, as it has existed for ^^me' time, i^ ,an interactive, narrow- 
band medium jDy which voice and digital (Touch-tone) signals ^ 
can be transmitted from any location to any other location 
on the xvetwork. 'Aadio-based systems could be conceptualized, 
but in practicality are not appropriate to the application^ jit 
hand. . ' 
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A second dimensioa pertains ^to the amount of data which the 
system can accept in a single transaction. This dim^sion 
is particularly important, in discriminatingl^tween the^ 
various telephone-based systems. One set of technologies is 
'S ingi^response systems in which only a single, discrete re- 
sponse to a single, closed-ended ques-tion is pc^sible, A, , 
second set' of systems will accept multiple responses in a 
sinqle^ transaction,^ 

Each individual technology will be .discussed in terms of 
operational description and costs. Because of the similarity 
among technologies within each category, »an evaluation of th^ 
systems' limitations * and t^heir appropriateness to the identifi 
• applications will be discussed at the end of -each subsection. 
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A. ^Two-Way Gable (Broadband Multiple Response^System^) 

• ». ! ■ " ^ ' ' '""V 



System s 



a. 



QUBt . Since the eairly 19 703% Cable has been regarded as 



We revol>utionary means, of providing interactive ^er/vices to 
the home.:.. In fact, it" was'' 'the Warner/Amex * s QUBE cabl^ system 
in Columbus, OhioJ that by aught "interactive television" into 

\ ■ >v ■ • 

reality/ VjLewers ^cobld "jialJc bifcck to their sets" hy pushing 
one of five buttons on their- q^ble converter (which contains a - 

microprocessor) , and their responses were continually polled by 
the central completer at the cable headend. A question could be^ 
as and the results tabulated within 20 seconds. 



1 



Th>e QUbE system gained notoriety for being able Jbo conduct 
.informal polls of the viewers and to fjrovide Lnteoractive tele- 
Vision. On one occasion, QUBE subscribers were allowed to 
vote^^3ia-_qjjio stion s r^alsed by the.. Commissioner of th'^ U.S. Food* 
and Drug Administration. NBC used QUBE tb elicit r^fsponses 
to a presidential speech, while anothe'r^ime, viewer^ ^had an 
opportunity to call plays for a local' junior collegeAf^tball 
1:eam. In an experimental research application/ CPB used QUBE 

^ • ' - . ^ ' "\ ■ • / <^ 

to identify evaluative wordavjand phrases viewers use to 

< 

distir)^uish more and less preferred television programsC 



1^ • ' ^ ^ ' 

TIP ^. 7 \ ' 

b>. Other Syst^ems . Since -the time the Columbus QUBE system was 
put into operation ,x the 'availability of ^new hardware configura- 
tions'has greatly enhanced the potential of two-wa^y. cable systems. 
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For example, QUBE III, manufactured by Pioneer, allows home ^ 
converter/terminals to communicate with the central computer at- 
shorter intervals using up to eight numerical digits of var- 
iable length data (i.e., responses do not have to be in a set 
format). In addition, each converter is addressable: thj^ 
computer can identify responses from each household a^rid main- 
tains a high level of redundancy for correcting errors 
Similar technology is being developed by Tocom, Oak^Jerrold, 
and Scientific-Atlanta. ^ 

2. Limitations of Broadband Multiple Response Systems 

The main drawbacks to two-way cable technology lie not in the 
technology itself, but in its limited availability^ Although QUBE 
"is ovter three years old, Columbus still remains only lo- 

cation in which two-way cable capabilities exist. In fact, the 
QUBE system is available in only one section of t^hrat city. 

> 

Although many franchise applicants are Tiow proposing the speedy 
deployment of two-way services, the necessary hardware and soft- 
wajtre developments are seriously lagging, raising doubts about 
the ability to deliver on these stated promises ( Cablevision, 1981) . 

In the near future, fully two-way cable services are likely 
to be available in only a few scattered locales. V7arner/Amex is 
building QUBE systems iri Cincinnati, Pittsburgh, Dallas, Houston, 
and in a number of smaller municipalities, but most of these systems 



- are several years away from completion. .Cox Cable is also leading the 
^^way in developing two-way services with its INDAX system. INDAX 
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is presently being implemented on the Mission Cable System 
\ * ♦ 

, ^ San Diego, Calif ornia ' (the larg'est cable system in the 

country) and is promised for recently awarded franchises in 
Omaha and New Orleans. Thus,^ the adoption 06- two-way cable will 
proceed very slowly. Ir will be decades before it (or any form 
of cable television) is used by ' a Cross section of the general 
population. Even *where available, two-way cable systems will 
not bQ: ifiterconnected and compatible, since each municipality 
issues separate cable franchises to different operators. Thus, 
aggregatio/i of data across geographical areas may be difficult. 

How. two-way cable will be utilized, even when available, is not 

totally clear. The ,most likely uses of th^two-way capability 

will be in those areas of the highest economic payoff, e.g., 

security, banking, shopping, cabletext, energy management, 

and .pay-per'-view programming. Although the use of two-way^ cable 

for research purposes has been cited as a possible application, 

few ca'ble operators have -begun gearing up to offer such a service 

- beyond one-shot, speaial studies. To support an on-going research 

service, appropriate computer software must be designed, 

specialized personnel employed, and additional hardware added ^to 

.interface with the central computer. Concerns have already been 

raised about potential threats to privacy posed by the integrated 

■data bases which could be generated by two-way systems ( Los Angeles 

Times, 1981). For the most part, it must be remembered that 
— 7- 

cable operators are primarily in the cable television business, 
and research services might seem like more trouble than they are 

\ 
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worth to cable operators. 
/ 

3. Applications of Broadband Multiple Response Systems 

Technically, two-way cable systems are excellent for all 
suggested applications. The direct connection of the viewer to 
a centralized computer ^allows rapid and accurate data collection 
in both continuous aflfi discrete modes. Turnaround tiiiie^is *quick, 
peak capacity i^ unequalled by narrowband systems, and large 
sample sizes can be easily managed. Th,e ability to address 
specific households makes each respondent identifiable (for 
quality control purposes) and allows test sKows to be narrow- 
cast to only those participating in a particular study. 

While two-way cable meets the primary requirements of the pre- 
testing interactive programming applicatione in markets wi^th two- 
yay systems, it has limited applicability in qualitative rating 
and'^public opinion studies. The major limitation is that not • 
all the residents of a given geographical area may be two-way 
cable subscribers, which would not allow a representative sample 
to be drawn. In" addition, the incompatibility and uneven dis-v. 
tribution of the various cable systems across the country will 
not allow truly national samples to be drawn for any purpose for 
decades to come. • 

9 

4 . Costs . ' ' 



Since research services on ,two-way cable systems are not currently 
available on a continuing ope'rational basis, it is 'difficult to 
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assign a. cost to them. It is not appropriate to use the custom 

t • 

Studies conducted by QUBE as benchmarks, because they were 
"special" and do not truly reflect the operational costs which 
yould be incurred on a regular basis, Thfe cost of each indi- 
vidual terminal is about $230: The terminals are'^usually offered 
•as part'of a "tier" in cable system price structures at an 
additional ,$3 per month over and above the basic cable service • 
In addition to the terminal rental fee, subscribers pay a monthly 
f.ee to use the service* Typical costs for a simple two-way 
sefvice (e.g., security or fire protectipn) are $20 per month 
per subscriber. Using this as a' base cost, if a research^organi-. 
zation wished to introduce a respondent into, the two-way cable 
network ^or purposes of data collection, it would cost the 
researcher^s at- least $23 per household per month. The cost§ ■ 
of recruiting subjects, data analysis and narrowcasting test 
material to respondents w6uld be added to this figure. 

B. Telephone-Based Single Response Systems 

1 > Systems . * ' ' 

a. Dial-It 

...... . ^ 

1) Description . The American Telephone & Telegraph Company 



(AT&T) began offering a mass calling service in September 19 80 

called Diai-It. The service is designed to serve mass calling 

applications. The application of interest here^is Media Stimulated 

Calling in ^hich a large number of callers attempt ;to reach a 

single set of telephone numbers as 'a result of. advertising the 

t 
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number on radio or television. D^al-It channels the calls 
into s^pecial nodes which can handle heavy traffic, thus pre- 
venting interference within the regular switched network 
facilities. The Dial-It system is comprised of seven nodes, 

each of which has a capacity of serving^ as many as. 1,800 callers 

« 

simultaneously- Since the system operates within the structure 

of the telephone netwo^^k, multiple telephone lines to private 

locations are not required, and the system can be accessed by 

any telephone. ^ 
-* 

Dial-It can be utilized as an audience feedback system by asking 
' callers to express their opinion-s on one question at a time by 
dialing one of the several telephone numbers, each associated 
with a specific answer to a closed-ended, multiple-choice question. 
A .possible scenario would be the prese_ntation of a question during 
a television program in which viewers are instru^-^^to diaX^one 
telephone number for answer^ A, anpther telephone number for 
answer B, etc. The^ results of the poll would be determined by 
• the -number of peop;.e who callU each o^ the respective telephone 
numbers in a given time period. Daily reports of the^results ^ 
are "provided as pdrt of the basic service, ^and minute-by-minute 
tallies of calls are available for an extra hourly charge.j^ ^ 

This system was utilized by ABC to poll viewers of the Reagan- ^ 
Carter debate in October 1980. Almost 725;000 people partici- 
,pated during vthe 100-minpte period following the debate,- with 
8l5 callferV dialing the' Reagan nxipiber and 243,554 dialing 




Carter number. 
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Dial-It also allows randomly selected calls to be forwarded to 
specific telephorje numbers, whereupon the sponsors- can directly 
communicate with the caller f oi^^dn-depth interviev^s. Otherwise, 
the caj.lers simply receive a prerecorded message thanking them 
for participating in the vote.* fPechnicai-ly possible-, but not 
currently offered by AT&T is voice storage, in which the caller 
can leave a ver&al message or a string 'of digital impulses 
input^ from Toucfi-tone telephone keypads, 

2) Costs . The qost fq^ using the Dial-It service includes 

( , 

charges to the , sponsor and the caller. There is a $5,000 annual 
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fee charged to sponsors for access to the service. In addition, 

V 

there is- a charge of $500* per announcement, per day, per time 
.zone for the basic service package, which includes (1) cut- 
through capability, ^or thfe abil ity of t he sponsor to interview 
selected callers; (2) a 15-second announcement capacity ;^ (3) multi- 
^ pl^ telephone number^s which are assigned to closed-ended responses; 

(4) announcement updating a^ required; and (5) daily volujj^ counts. 
Additional charges apply to longer announcements (i.e., $100 foir 
a 25-secbnd announcement) and minw,te-by-minute tallies ($50 per 
hour) . These charges are not day-segment: sensitive, but the 
telephone company reserves the right to limit which times the 

^ • v. • 

service is available; 

Equally important is the charge to th^ caller for 'Utilizing the 
service. Fifty cents per call will be charged to each user, 

which will automatically be added to their monthly telephone 

" • * * 't 

bill. In the Reagan-Carter application, AT&T not only received 
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$7,000 from ABC for the use of the servipe (including the annual 

fee); but also over $360,000 in charges collected from callers. 

b. VOTRAK 



1) Description . VQTRAK, marketed byf Unlimited Television, Inc. 
(UTI) of New York, is promoted as a "t^o-way" television system, 
.It operates much like the "Media Stimulated Calling'* of ^ 
AT&T's Dial-It service. In fact, VOTRAK ' s inventor, John J. 
Root, claims that AT&T has infringed upon tiis patent and plans 
legal action. 

Similar to Dial-It, VOTRAK allows television viewers to- respond 
in real time to a closed-ended; multiple-choice question. Each 
designated answer is assigned a , unique telephone number which the 
viewer dials on his/her telephone in order to "vote" for that 
particular alternative. When "the connection is completed, callers 
hear a short recorded message thanking them for participating 
and telling them that their "vote" has been registered, and then 
they are disconnected. Results of the number of calls received 
by each telephone number are then tabulated. A television camera 
pointed at counters on the side of the device could allow 
the results to be superimposed on the television picture during- 
the voting. In addition, the system enaSles calls to be inter.= 



cepted for further questioning ^of the respondent by an interviewer 
or even^by an on-air host. 

• Since all the system does is count calls, any telephone could 
access *the system, but only one question can be voted upon in ^ 

ERIC . ' - 33 - 



31- " 



any one call, 'Connect time with the system is approximately 
six seconds, thus allowing about ten callers to be processed per 
minute per telephone line. 

Multiple telephones lines are required for each ariswer in order 
to handle a higl? volume of calls within a short time period, 
' The number of telephone numbers required is a function of the size 
of the viewing audience, the percent of Viewers who participate, 

and the duration of time in -which voting/is allowed, UTI states 

. J 

that 20 telephony. 3; xrr^s would ^be^ sufficient to handle responses 

/ 'i^or an' hour tel^ision^-^rogram with a- "2^' rating in Ne*w York, 



.VOTRAK was utilised by a local New York television station 



I 



: (WNEW-TV) in August- September 19 76, as part of its Ten 
/ O'clock News program and on the New York City cable systems 

(Manhattan Cable/Teleprompter)^ in January-April 1978, In. the 
first application, viewers were polled as to theix opinions of k 
the "question of the day"' with "yes" and "no" responses possible. 
The number of respondents varied according to the question asked, 
with -participation ranging from 4,150 to 25, 99'7 and averaging 
at 12,470, UTI calculated that an average of 2,9% percent of^ the 
average quarter-hour ADI homes reached by the program responded 
and that viewership of the program increased 40 percent during 
the period of the VOTRAK test, 

2) Costs , \4QTRAK is available' on a monthly lease basis, 

UTI quoted CPB a rate of $6,000 per month for a 20 telephone line 

capacity and for up to ten -uses. There are additional^^charges 

« 

* 
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o£ $600 for each tim^ above* ten, an installation fee and tele^^, 

phone ;Line charge to be paid to the telephone company, l*he 

latter migjit be absorbed in overhead by stations which ftiaintain \. 

the multiple 'lines used during pledge and auction periods • ^ It 

roust be noted that these charges are probably nefgotiable, since 

m 

they fluctuate arrross UTI documents. 

« 

. / 0 * » ^ 

c. Telephone Answering Machines 



1) Description . ''Dial--It and VCBTRAK operate as telephone answering 

devices, which simply play a prerecorded" fhessaaea-and count calls* * 
There is no reason why such a system could not be assembled by ' 
purchas-ing several telephone answering machines, attaching them 
to telephone lines, and assigning their telephone numbers to 
different response alternatives. Results would be determined 
by summing ±-he number of calls recorded on jthe appropriate counters 

P Costs. A configuration of telephone answering devices could 
be assembled for an up-front capital cost of approximately $150 
per telephone line. The only operating expenses wouW be the 
cost of. tji6 multiple teJ.ephone lines, which many public ' stations 
maintain anyway, and the cost of personnel to tally the'^.calls. 
However, answering machines would work more slowly than VOTRAK 
so tl^at a larger number of lines would, he needed. ^^he volume 
VOTRAK could handle with 20. lines would g^pbably require 75 , \ 
lines wit>i answering mac^i'^es , an initial outlay or-qver $10,000 . 



2.* Limitations of Telephone-Based Single Response Systems 

The- major wea^k-ness of these systems is that they' cannot handle 
multiple responses, .i^e,, only one response can be recorded per- 
.interaction with the system. Without the a'bility to elecjtronic- 
ally transmit individual identification codes, respondents, cannot 
*be readily identified. This maintains anonymity but does not 
all*pw the kind of quality control essential *for public opinion . 
^ pc|^ling or qualitative ratings. • • ^ ^ 



In addition, ,the fee that Dial-It passes on to the caller could 
lead to "class bias," in utilizing- the system. Lower income* 
individuals would be less 'likely to participate if they are required 
to pay a fee. Charges of "elitism" were levied against *ABC by 
pollsters following its Dial-It application in the Reagan-Carter' 
debate. ' 

Another problem is that even very large numbers of telephone 
lines cannot handle the peak loads generated by media-stimulated 
calling. Although 320 telephone linei were utilized in VOTRAK * s 

^ WNEW trial (of whicft half the^lines were for a positive response 

and the other half were for a negative response), only 46.8 percent' 
of the attempted calls were completed during the hour program 
^cording to a New Yo^k Telephone company memo. With such 
a' low completion rate for phone calls and with the s^elf-Selection 
sampling bias, the results of the poll. cannot be said to refleqt " 
[the opinions of poll participants or of the WNEW viewership. 
For -example, the true* distribution of answers to a question 

• ^ could.be 70 percent- 30 percent, but if only an equal number of 
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people can get through for each side, the results would be 50 per- 
cent-50 percent. Na,tional Public Radio reported that a 'similar 
problem arose during its Dialrit application, when* callers fro^ 
'urbaft areas (presumably Democrats.)^ had more difficulty in getting^ 
tfirough 'than callers in rural areas (^rSsumably Republicans) • 

With possible exceptions in smaller markets, none of--t^i'ese 
systems can--he counted, on to provide equal agces^ to all-poten- 
tial callers\ Therefore r some kind* of preselection process ^ 
(e.g.'/ viewers apply, in advance by sending an* stamped, self- 
addressed post cards) is in orde^. 

Finally, the self-selection bias alse prevents generalization of 
the results to' the' jrommunity . This flaw was emphasized' following 
the >Jew York cable test and' resulted in- the disuse of the system 
on, the government access channel. 

3. Applications of Telephone-Based Single Response Systems 

The single response capabilities of. these systems immediately 
eliminate their consideration in pretesting and q,ualitative 
ratings .applications where a large amount of data must be collecte 
from each user. In publlc^^opinion polling and qualitative rating 
studies, these systems are not desirable because of the lack* of 
quality control over the sample. Public opinion polling requires 
a high quality random sample, yhereas these systems rely on the 
ca-llers to. self-select into them. Preselection "bf a random ^ 



sample of indiyiduals and obtaining *Eheir cooperation in ad- 
vano^^ might? help m5tter«^ However, the necessity of havij^g 
^ tQ viisw a particular prc^ram at a particular time would probably 
redu^ the response rates to leveL^* unacceptable to public 
. ' opinion^ pollsters . ' 



The single response systems afe cleanly best suited to inter- • 
active programming applications^in which viewers can respond 
to questions posed one at a time dyring a show. The Dial-It 

service.^is technically/super ior to VOTRAK "^by virtue of its 

A. 

greater peak load capacity and national reach, but the 50-cent 

* . ^ 

charge to callers could limit its accessibility to a la2?ge 

centage of viewers. Utijl^S^l^ a bank offetelephOne answering 

machines could prove cumbersome but might perform as well as 

VOTRAK given enough telephone linefe. It «must be kept in mind 

• .^^^ 

that r^'stiits obtained fronj aoy -.of . these systems should be 

ufeed only fo^ entertainrn^nt purposes , -.^nd no generalization of the 



findings should be made to popu*lations other than 'those who 



actually call in. 
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C. - Telephone -Based Multiple Response Systems 
1. Systems. ° - ' ' 

a . VOXBOX " 1' • 

1) . Descriptipn . " 'i^*.D\ Percy Company operates a qualitative 
research system in 'Seattle/ Washing*ton, utilizing ai^* electroniQ 
home* response terminal cabled the VOXBOX. The ^ercy System ^ 
includes 200 households Which are'^^asked to evaluate" the tele- 
^ vision programs ^that they watch on an eight-point s|;aleX,^T)ie^ 
^^^units are'' connected to the television set ahd also serve as a 



channel se]^ector.,. They are connected by njeans of dedicated 
telephone, lines to ^ central computer, where qualitative re- 
sponses and cHannel selection data are continually monitdred 
throughout the day. This service ^provides syndicated reports 
of the qualita.tive evaluations of the programming and' com-, 
mercials in th^ Seattle area, much the same -way that Nielsen* 
and Arb'itron provide quantative viewership data for, television 
and radio. , ' - ^ ^ " 

2) Costs > The Per cy"^ Company sells-. its Television ^Program Pre-' 
ference Guide, containing summaries of qualitative responses to 
.programs At^ a cosit of $950 per month. Single-program results 
(e.g., when a pilot is shown without recruiting to view) are avail- 
able for $500 per show. A pretest for which panel members ' ' 

would- be contac^/^ in advance and invited to view would cost 
$1,200. ■ • ' ' / ^ ^ ^ ' 

b.^ PEAC * , " * ' ' ' 

1) ^ Description . The Program Evaluation Analysis Cofnputer (PEAQI , 
designed and marketed by PEAC Developments, hasNpeen extensively 
Utilized as a foriaative research tool to evaluate radio, television 
and f ii^rj^arterlc^ Chen, et al., 197^9)j The .current version^ 

of this system, \PEAC I, is designed to allcfW' an audiei)^ to respond 
to test materials N^y inputting numbers into hand-held micro- 
processor x^^cp^^sT. l^h^^esponse units are prdgramme^d before the 
testing perWd &y a microcomputer. Follojving the session, the 
units are^placed ,into *a case at which time the stored data are 



loadecJ into the microcomputer fo# aioalysis . The results are 

presented by means of a cdlor graphic display; whi^^h can be 

super impos^d-^^^er a replay of the test . materials • Although 

PEAC I is portable and flexible, i^: tcan be used only in con- 

trolled settings, and units must be returned to their case for 

programming and data retrieval. A more sophisticated version of 

the PEAC system, PEAC II, is under development and would be 

placed in individual homes. The 'units would communicate with 

> 

the microcomputer by means of telephone lines.* The response 
unit can be wireless, and it would fit into a modem connected to 
a telephone jack, when not in use. 'Each unit would^have a 
capacity of 500 data points and could operate by sampling 
'responses at five- to 60'-second intervals or by recording discrete 
answers to multiple-choice ansv^ers. 

/ 

The system could operate in one of two modes. In the first, 
conutfan locations between the centr.al computer and the home ter- ^ 
minals would be fully automatic. The computer would have a ' 
list^of respondents' phone numbers and woui^d dial each in suc- 
cession, giving the respondents verbal instructions' for the * 
test session and, programming the response units. After the pro- 
gram, the computer ^ would redial the units and collect the data. 
Neither researcher nor. respondents would be burdened with tele- 
phoning. • ' ^' ^ . * . » 



In the second -mode, communication between the researcher and 
respondent* would ijot be/fully automatic. The^ researcher would 
manually dial each respondent and give instructions fox the test 
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'session, and the respondent would call back the central computer 
after viewing the test program. programming the response units 

;and collecting data would^ still be done automatically by the, 
computer. 

2) ■ Costs. The PEAC IP "System would be easily implemented in 
— « 

any household though -high unit cost of the terminal would 
necessitate having the units remain in the same locations over 
some period of time. Although PEAC II is not currently marketed, 
its anticipated costs are between . $39 , 000* and $42,000 f or a^ 
system inciting 30 in-hfeme response terminals, central computer, 
necessary software, manuals, and training. Each additional 
in-home response terminal woujid cost $650, and automatic dialing 
of respondents and accessing of data would be another- $6,000. 
The unit would have to be installed and disconnected by a skilled 
technician, and respondents would have to be trained in its use. 
PEAC estimates the cost of evaluating a 3 0^niinute program with 
100 in-home respondents Would* be approximately $3,000 with 
data available the "liext ' day . However, these, costs apply to 
studies iry a single metropolitan area. Installation, training 
and communication costs might increase dramatically fot a national 
or multi-city sample. 

* » / * 

c. Computafone * . 

<^ 

1) Descriptionj > Compu-taf one , marketed for media research *by^^-^ 
Media*"SdBnce Measurements of New York, offers a versatile 




• In Canadian dollars 



s 



41 



- 39, 



system for conducting telepRb^a surveys. It can automatrcally 

4 >^ 

dial telephone numbers', based orr" inputted telephone numbers or 
random numbers, "ask questions on prerecorded tapes, and accept 

responses by means of Touch-tone impulses, rotary pulses, and , 
verbal messages which are recorded on tape. Thus, both quanta- 
tive and qualitative information can be elicited"-£rom respondents. 

The unique characteristic of this technology is the ability 
to accept both digital and analog data. For rotary telephones, 
the pulses of the dial are translated into digital form. In 
order to correct for pulse slippage (i.e., in order to identify 
precisely which* number is .dialed) , the respondent is asked to 
dial a specific number at the beginning and at the end of the 
interview, and the computer automatically corrects all responses 
to that basis. In cases when the two test responses are not in- 
ternally consistent (Which is said to happen rarely) , the respon- 
dent is asked to repeat the answer verbally and the responses 
are recorded on tape. 

? 2) Costs . Thfe system will be available soon in two forms. 

Individual units will be sold With one^ to three telephone line 
capacity, ranging in price from $6,300 to $10,000. In addition, 
regional bureaus are being formed from which time can be leased. 
The initial bureau will be opening in New York in August-^ 

September 19 81 and will focus on media research. Already, 20 
advertisers have been said 'to have •become charter members of the 
burfeu. The cost o:^utilizing the bureaus will be $50b per hour 
for use of 45 lines, though price will vary according t6 the 
exact specifications of the services requireqi* 
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d. The Communicator ^ , ^ ^ 

1) Description . The Communicator, manufactured by Information 
Technology of Fresno / .California, is principally designed and 
marketed as a telephone dial access information service • Dial 
access connotes systems which allow callers to dial a telephone 
number in order to request an audio cassette to listen to. One sue 
se*rvice that is now offered across the country is Tel~Med, which 
provides medical information to th'e public. 

Usually an operator is required ta answer 'phone calls and to 
insert th^ requested tape into 'the. player • The Communicator 
, improves upon this procedure by allowing the caller to request 
messages by inputting the appropriate codes using a Touch-toi^e 
telephone, thus reducing personnel requirements. The system 
has a stored message capacity of 900 minutes which can be seg- . 
mented in as many ways ^ar^ desired. 

The Communicator also provides a printout of the frequencies .with 
which each message has been accessed during a specified time 
period. It is this feature which Information Technology has been 
marT^eting for conducting polls. The cades, instead of represent- 
ing stored messages, could be assigned to answers of closed-ended, 
multiple-choice questions. The unit can accept only three digits 
per telephone call, meaning that a maximum^ of three questions 
could be asked. The questions might be posed before the caller 
dials up the system, e.g., during a television program or by 
a mail questionnaire, or in the opening message the respondent 

o ■ • 43 . 



41. 

J 

% ' » • i, 

hekrs after calling the sQorvice. At the end of the allotted 

respons'e period, the frequenid^\pf each response can be printed^ 

out at a push of a bul 

2) Costs^ The unit costs $5,700, and each unit can handle only 

one telephone line. Although operator intervention can occur when 
callers do not have push-btitton telephones, the system would • 

only be' practical in the autbmated mode. To date, thi,s applica-- - 
tion of the technology has not been used by clients fqr r^esearch 

purposes, and 50 no firm cost data are available for such appli- 
cations, ' . ^ 

e. Audio Response S^etvice (ARS) 

^ • — <^ ^ ' 

1) Description , ApS is offered by the Service Bilreau Corporation 

of Greenwich, Connecticut, The system allows callers to access 

computer ized information banks with their Touch-tone telephones. 

In a research application, demonstrated by us for another project, 

ARS was used to collect a series of responses .to closed-ended 

questions which, users entered automatically through hand-held 

automatic telephone dialers (see following section) , The system 

has a computer-synthesized voice which directs the user through 

the transaction. The computer could be used to ask questions, 

although the quality of » the voiW is rather poor. Data 

could also be input- manually by owners of push-button telephones. 
The .system is served by 18 WATS lines and can be accessed from 
anywhere in the country.' Up to 256 digits can be recorded per call. 
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Researchers can access a wide variety of statistical packages 
also offered by SBC on the same basic computer system so that • 
data can be turned around within minutes. * ' 

r 

2) Costs. ARS charge^ are, calculated by the amount of connect 
time at $2(f per hour. The clock starts running at the moinent 
the users' identify themselves to the system with their user 
access code. —There is a minimum charge of $100 per month for 
the service. Additional costs would be charged for programming 
changes in the user dialogue and for data processing. 

s 

f . PAL-Consumers ' Computer 

1) Descriptipn . Product and Area Locater (PAL), developed by 
San piego-based Consumers* Computer Corporation of America, 
allows inc^ividuals to access computerized consumer information 
services, e.g., where '^to buy a certain product, through the use 
of a Touch-^one telephc5ne. After dialing the computer and hear- 
ing a welcoming message, the caller inputs a residential ZIP code 
and the code nomlSer of the service desired which is identified in 
the PAL guidebook. The computer's voice reads back the tele^ 
phone numbers of up to three businesses in the consumer's ZIP 
code which provide- the desired^ service . ' 

PAL also has the capability for conducting public opinion research. 
Respondents, can express opinions by inputting responses using the 
keypad of a Touch- tone telephone based on questions asked by the 
computer (which can branch -to appropriate questions based on the 
caller's responses) or prior instructions distrit^uted via newspaper 
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mailed surveys, or panel instruation packages.' The current 
configuration of PAL has a capacity of handling only 15 / 

local telephone lines simultaneously.' There are plans to 
establish local PAL bureaus throughout the couptry. A detailed 

description of a research demonstration involving this system 
• »- ♦ • ' • 

is found in the following chapter^^.and in Appendix A. . . ' 

' - ' ' 

2) Costs . PAL is not primarily /a research service and* so there 
is* no firm cost structure for such purposes. A fee of $500 was 
charged for the demonsjtration project described in the following 
chapter. The fee covered programming, data collection and trans- 
^^er. A cost o/f^ ten, cents per transaction has been estimate^ for 
research applications'. 

g. Automatic Dialer Technology > 

1) Description. ' Uaeful adjuncts to telephone-based, multiple 
response systems are portable telephone 'dialers. These device^s 
are not in themselves audience feedback ^systems, but could augment 
systems like Computafone, ARS and PAL in two iinportant ways: 
(1) They give users who do not have push-button phones access 
to the system, and (2) ;tdiey can dramatically reduce* computer • 
connect times by storing data "off-line" and playing it through 
the phone system in a single burst. The latter application, was 
recently demonstrated by Applied Communications Networks (ACN) 
using ARS. 

Of particular interest are- hand-held, cordless devices that do- 
not require the intervention' of a telephone company installer. 
A portable dialer offered by CES Industries (Model 335) is one 
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such device. It allows users to record and store up to twelve 
16-digit numbers.- The device is about the size of a package of 
cigarettes and is used by holding it directly over the receiver 
of by coupling it ^to the phone with a simple earphone-like exten- ^ 
lion, A similar device, Porta-Touch, will soon be of fered by the 
BUSCOM System?. A number of companies offer portable Touch- 
tone generators without . memory-. These include Soft-touc^, another ^ 
BUSCOM product, and Digitone, a product^ of Digitelle. 

2) Costs. Memory dialers retail for about $125 each but can be . 



bought in quantity for well under $100. Dialers without memoj?-y 
retail in the $30-$4p range. 
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2. Limitations of^ Telephone-Based Multig)le Response Systems 

Of the systems described within tlfis category, the Percy VOXBOX 

is the' only one which ailows continuous processing of response^ 

♦ 

during the actual viewing of a program through ^dedicated tele- 
phone line to the central computer. The operating and installa- 
tion costs of the system are hig^^, limiting the 'size and flexi- 
bility of 'the sample. While there are plans to expand i t to 
other cities, it will not be, available on a true mul'ti-regional , 
let alone national, basis .for some time^ '''I^iere thus remains a , 
•question about the external validity responses made by ^ 
200 subjects in Sea^le', Washington. tb^e is also a question ^ ^ 
about the' internal validity of a procedure which requires participant 
to actively respond (unlike the Nielsen Audimeter families who are , 
unobtrusively monitored) over a long period of time. The system 
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als9 lacks flexibility in that all the responses relate to the 
Standard eight-point adjective scale; additional questions could 
not easily be handled by the system. Furthermore, thp'»"e are no 
specific quality controls' to verify vho is pushing the button. 



PEAC is a highly sophisticated system which allows continuous 
monitoring of responses, although the in-home version is not 
currently available. The system will incur higfe installation 
costs, since a visit to each household would be required to. in- 
stall the unit and teach ^the individuals how to use it. 
Control could be maintained by requiring the respondent using 
the system to input a- unique identification code. Although the 
in-home system could be implemented on a national basis, it ife 
likely that it will be confined to a small numbe^ijpf metropolitan 
areas for some time to come. ^ v 

* 

Computafone is pethaps the most flexit>le of th^ various telephone- 

• " \. 

based, multiple response technologies. It can ask questions in a 
clear, natural voice, accept input from any kind of phone, and . . 
record open-ended responses. The automatic: dialing capacity 
of the system could allow^the system to conduct large rafidom 
surveys with minimal human labor. However, the laws of many^ 
states require that the permis^Xon of the individuals must be ob- 
tained before the automatic dialer is Utilized. Thus, the greates 
potential benefit of this system goes for naught since respondent 
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retruitment costs still it\u^ be incurred • The system also has. 

a raiatively^ large input capacity. However, it is envisioned- as 

a regional, rather than national, service that will be initially ' 

available in onl]f-^a single market. *J 

The major limitation of PAL, ARS and The Communicator is tf^^ need 

of Touch-tone telephones to input resp6n¥es7 It is estimated that 

only 38 percent of the t ele phones in the United States are Tauch-ton 

andf technical problems with telephone connections reduce that 

number slightly. However, there are Touch- tone adapters available 

which could easily be distributed to members of a sample so that 

they could respond. In fact, these devices might be' more de- 

•sirable than using the Touch- tone pad on the phone because they " 

'are portable and have memory. 'This would allow the respondent 
to record responses while watching a program and answer questions 

before agoing* to the*telephone . Also , ^"lihe telephone number and 

/' 

respondent identification could t)e stored in , the unit in orde^: to ^ 

fadilitate access. ^ * _ ^ • « 

The Communicator is limited by the small number .of responses (three) 
it can record per call. These limitations do not apply to PAL 
or to ARS. A prpblem unique to ARS is its ^ra^ther gai^bled computer-^ 
synthesized voice. Unlike the) other .systdms in t\iis category, - 
it^ could not be lised to ask questions unless tespondents were 
provided with a written copy in^^dvance. However, ARS has the 
unique distinction of being the only audience feedback system 
currently in operation that can* be accessed ^t no ^^ost to the 
respondent from anywhere in the country. 



•V 

3. Applications of Telephone-Based Multiple Response Systems 

The limited capacity of these systems rules them out for most 
interactive programming applications • Conceivably, a sufficient- 
number of phpne lines could be attached to systems lil<^e PAL, . 
ARS or The Communicator to handle the high peak 'loads lof this 
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application, but no system currently in use has suff.ic 
(Capacity. Since Computafone is an outcall system (it 
the call), it is not suited for intera.ctive prograramm 
where the respondent calls in, ' 1 



lent 
plaices 

applicant ions , 



V The inability of the Percy System ^^d the, Coipmuni cat/or to 

identi^ respondents rules them out ^r '^blic opinaon polling*. 
ARS, iPEAC or PAL could be used for polling -if resj/onde^s^ were ^ 
a recruited in advance and "agreed t6 watch the program in, process. 

Respondents could be identified by entering' unique identif icoition 
'codes. .^.However, PEAC and PAL will be geographically limited. for - 
some time to ciHne. , ARS cannot ask intelligible questions unless 
We respondents have the question protocol iti front of them. "Al^ 

A 1 ^ - \; ■ - ' ■ ■ . • /* ^ 

qhree systems require push-;^u,tton phones for access, introduci 
^ serious sample bias. 

"Computafone would be ^he ideal technology fpjr polling, if 
legal prohibitions on '"junk calling" were lifted. As it is, ' -\ 
respondents have to b^ recruited and their permission secured 
in advance. The method of . accomplishing this currentl^y proposed 
by Computafone (i.e., mailing notifications in advance to re- 

spQjpdents selected from reverse telephone directories) *Would probably 

E^ . ' ' / • 50 ' r , 




not be legal in some states. It certainly would not satisfy 
public opinion researchers, since only individuals with listed 
telephone numbers would be ^included in the ^sample. " 



For qualitative ratings, ARS is the^only feasible system at 

present since it is the only ope available on a truly national 

basis. However, it can only be/used by bwners of push-button 

telephones, introducing an unacceptable sample biag^ It would 

be desirable only if used in conjunction with an automatic dialing 

device. The same strictures apply to PAL and The Communicator. 

The Percy System would not be ideal, even Vf nationally available, 

since it does not allow sufficient <:c*itrol'^ver: who is responding. 

Decision makers would have no way of knowing how different popu- 

latiorTTegments react. PEAC II ^uld be used in this application 

if it were to become available nationS:±ly. Its high storage 

capacity would make it especially attractive iii this "data inten- 

sive" application. However, PEAc"lI, VOXBOX and ARS Would all 

require^ panel design to offset, the costs of the t^minals or 

automatic dialers. ^ "^^^^ , ^ ^ ] 

o * ' ^ S ' 

Once again, Comgutafone is a definite pos'sibility ifTan acceptable 
way can be found to work around the "gunk calling" laws^ while not 
introducing .unacceptable biases in the sample. If a ^panel study 
apprqach were adopted, it might -be feasible tp ^recruit , subjects 
in advance by phone and then call them' back at specific times 



during a "sweep" to <:ollect their diary -data. Howeyer, this 



would be a rather tedious ta&k, for the respondents unless they 
had" an -pf f-line "storage device. The altfernative^4fl{Oul(l.be to 




draw a much larger sample and to perform telephone coihcidentals 
focusing on qualitative responses during the ^jiae^^'^ 



The ideal application for phone-based multiple response systems 
is pretesting. Here, the sample biases associated with different 
techniques could be offset lly the advantrages of rapid turnaround 
and th^ relatively high data capacity of the systems. PEAC was 
designed specifically for such applications and, when available » 
io the home, will have* the unique capability to record both con- 
tinuous ratings and answers to discrete questions with ease. The 

O 

computer int^^rface will make results available on a^t overnight 
basis.* With .thi>^xception of VOXBOX, the other systems in this 
category do not hav-e the capability of recording continuous ratings 

'unless such responses are first recorded on paper and then 
relayed manually to the computngr. However, if tmey^were used in 
conjunction with automatic telephone dialers, which could record 
responses off-line (much as PEAC would) , 'this problem could 

•overcome. In that case, Computafone would be the most desirable. 

since it could survey a large sample and'^perform any necessary 

' ^ • ' ^ ^ ^ ' ^ / ^ 

folldw-up calls with^high degree of efficiency. ARS and PAL 

^are also possibilities, arth^gh they have the disadvantage of 
not having^live operator^ interveh^ion^jor automatic recording of 

, open-ended responses as an inte'grai p^rt^^^of^the system. However, 
tjiese capabilities could probably be added at a modest additional 
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VOXBOX has i'imited utility as a pretest deviq^» despite its 
ability to collect continuous viewing data-. The operators of ^ 
the system are reluctant to use it in the invited viewing mode since 
theirs is primarily a syndicated data service. Specialized 
pretest studies invalidate the data they .s^ell to their regular 
clients. Without invifed viewing, the sample 'sizes are to6 
small to serve the purposes of pretesting. . 
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IV. A PIL OT ST UDY OF COMPUTERIZED PHONE- BASED DATA ACQUISITION 

, ' 7~^, h 

A common element across the interactive television technologi-es. 
and their various applications is tHe process of collecting computer 
readable data directly froiUi the home though a direct interactipn be- 
5 tween the respondent and a computer accessed via the telephone. 
Sinpe such technologies are not yet in common use, several ques-* 
tions arise concerning their feasibility. Will the public willingly 
and accurately use such systems? What are the potential Advantages 
to the researcher? WJiat bi/rriers exist to widespread application 
of such systems? What hardware and software components must a 
viable system have? 

To help answer these questions, we conducted a pilot study Of 
computerized phone-based acquisition af data ;from the home. 
The technology examined was a phone-based multiple response 
audience feedback system. In this test," users entered ratings 

into a 'computer using theiri^wn push-button telephones. The 

^ , ' - . ' • 

computer ' interface was the Consumers! Computer Corporation of 

/ ' * 

America's PAL- system (see Section III for a description). . 

The specif ic^application, tested was a qualitative r^atings study. 
The approach was to simulate a single "sweep" of qualitative , 
rating data collection employing computerized phone-based tech- 
nology. The City of San biego, California, the only city 1^ T ' 

' . ^ . : • ' 

Vhi€:h PAL was operational, was. the test Isite. Viewing^diarieB 
were, plated in randomly Selected homes , along with 'directions 



tor phoning in rating's to pXl- ACN asked to have the completed 
diaries returned to^ us so that we could compare the originals 
with the data output from PAL in order to assess the error rate* 
and ot'her^atterns of use. Any difficulties in using the system 
were identified through inspect'io^ of the N^omputer output, from 
follow-^p contacts with users, and from a series of , open-ended 
q^uestiojis printed on the backs of the diaries, • 

Since the goal was to 'demonstrate data collection technology 

rather than the concept .of qualitative ratings per se, we made 

a number of simplifying assumptions to peduce the '"lead time" 

j 

for the"^tudy and the magnitude of the tasks required*^ 

of the Respondents- Accordingly ad hoc scales of enjoyment, 

""""" » 

/ ' • ' 

worthwhile^i&jass and other qualitative^ dimensions v/^re used without 
attempting"^o-v^lidate or pretest them in any formal sense.* 
Rather, ^he focus of pretesting ^was on the ability of respondents 
to understand the directrons ifor phoning in their ratings. 
Instead of asking respondents to rate an entire week'^ program- 
m.i-ng, t'en^specl-f i'c programs-.,._iilcl^ programs, were 

listed in the viewing cjlary. Resppfidents were a'^Is^r asked to rai 

two programs of their own chpirce; however, we required that only 
the rating^ of a single program be phoAed in to encourage par- • 
ticipation by^ those who might have to leave theit* homes* to gain 
access to a Touch-tone phop-e. . 



^*The dimensions used were syggested by participants^ inxthe 
CPB technical conference on' qualitative ratings (fPB, \9 80a) 
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Two populations wer^ of particular interest: regular PBS 
viewers and Hispanic viewers. Accordingly, two separate samples 
were recruited. A sample of KPBS> San, Diego, subscribers was 
randomly select efl ' f rom the station's mailing list. A second 
sample of Spanish-surnamed viewers was drawn from a reverse^' 
telephone directory of San^Diego. A mail survey approach was 
used in an effort' t^o minimize cost§. However, this procedure 
yielded' such a disappointing response r,ate among Hispanic* that 
this aspect of the study wag repeated using a combination of 
phone and mail recrultijig techniques similar to those used by 
television ratings Services to recruit minority group members 

. ^- . 

their diary , studies . ^ " v ^ 
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In general, ±hose who used the PAL system* f ound^ J^, to -be'a^on-- 
venient and enjoyable way of responding questions about 
television programs. The few who found it to be ^exde^sively comr- 
plicated '^br had a problem using it reacted more to special con- 
ditions that' applied during the pilot test C^^.g.,- X^dundan^^^^ta < 
i entry by phone and by diaxLy, calling the system before it was 
turned on%* eth.) rather. than to inheofent flaws in^he technology 
itself. Some potential advantages ^from the respondent's point 
of view were also revealed. One respondent enjoyed the longer 
time he had to consider his answers 'carefully,, while another found 
the system less an invasion of privacy compared to conventional 
phone interview techniques. Theresas no evidence that users 

, \ . 56 . 



considered a direct interaction^ with a, computer to be either 
"dehumanizing" or an invasion of privacy. 

Nonetheless / the overall response rate was quite low in Compari- 
son to conventional paper-and-pencil diary techniques. Once 
again, this was probably' more a ^result of special procedures 
adopted for the pilot test than reflective of 'the technology 
itself. For example, re^cruiting for one phase of the study was 
conducted qver a period of three weeks prior to its initiation. 
Those contacted in the last couple of days prior to the study 
, exhibited response rates comparable to those observed using 
mail diaries / while those contacted ^earlier had^ much lower 
resj)onse rates. Language was another problem. Although ail 
materials wfere translated into Spanish, tj^e tone of the trans- 
lation was evidently toa formal and alienating for respondents 
whose dominant language was Spanish, and they responded in low 
numbers. Tho*se who were bilingual or dominant in English responded 
at acceptable rates. The fact that the. computer itself was English 
speaking may also have contributed to the 'low Response rates among 

Spanish-dominant subjects. Finally, it appears that a number of 

%. 

respondents believed, that they wefe being asked to view all cff 
the programs listed in the diary, despite repeated directions 
to the contrary. In sfudies that require viewing of "a particular 
show, response rates are often as low as ten percent, somewhat 
lower than the rates observed^ here . * Thus, the response rates 
wer^ acceptable after allowing for some of the problems that were 
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unique to the pilot study. Additional attention tp the problem 
of respcxnse rates, however, is clearlv in order. 



Data entry wa's^ remarkably error-free. Only percent of 
a^l entries intc^ PAL contained errors , using the paper-and-pencij. 
diaries as th^ standard of accuracy. Since each .transaction con- 
tained' 24 ctiaracters^-^only about one-half of one percent' pf all 
character/ entered were in error • About h^lf of these w6uld*W 



detectaj^le with interactive hardware sensitive to short character 
strings or illegal codes, so that the error rate' theoretically 
coul:d be greatly reduced. It should also be not^d that 
a/number of respondents who. said that they used PAL did nofe * \ 
actually have* their responses recorded. These re^spondents . 
apparently failed to enter the control character (#J that marked ^ 
'the end* of the dialogue, or else huji^g up before PAL responded 
to the final entry, thereby cancelling the transac^tion* 

"Some of the potential strengths of PAL and similar phone-based 
conjputerized sys'tems from the researcher's point of view were 

evideht from thefgilot- study Data were available immediately 
in compi;:fe:^r-readable form, sparing the cost and time of manual 
data prpce^^ng^ Assuming a multi-wave study ,> the costs of the 
technology would soon be offs.et by the cost of mailing, printing 

and manual data '.processing of * paper-and-pencil "rdiaries . The 

' ■* * ' I 

ress of data collection' could be monitored/, and targeted 

"* ' . 

follow-up phone calls could be made to correct problems that 

were >evident from initi^al inspection of the data. Although* not 
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implemented in the present s±udy,\such systems are capable of 
'detecting errors in data input (e.g., sho^'t strings of numbers, 
^illegal codes)' and of requesting corrections as the data are 

entered. • - 

ome potential barriers to widespread use of computerized phone- 
based systems were also apparent. Chief among these is the 
limited 'distribution of push-button' telephones , estimated to be 
less ^than 40 percent nationwide • Respondents without push- 
button phones were asked to use public phones or phones in their 
place of work equipped with Touch- tone keyboards • Although a few 
respondents did use phones outside their homes. It is clear that 
they considered this a major impositic^n. This approach is not 
practical on a mass 'Scale in studies requiring repeated data entry < 
^Nor can all push-button phones be used to access the system. Sonfe 
, consumer-installed^ phones with push-button keyboards merely >t:on~ 
vert the input into rotary d:^al impulse^, which cannbt be detected 
by PAL. Other push-button, phones have a conditio^ known^'as 

0 ' 

"polarity reversal," stemming from >improper installation, ^which ^ 
means that Touch-tones are not registered by PAL after an ' 
initial connection is made. There are still many exchanges,., 
especially in rural areas, that are not equipped to accept ' 
Touch-tones, whatever the nature and .condition of the phone in- 

strun\pnt. However, all systems can transmit Touch-tone after 
'th4 initial connection is made. 
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other 'difficulties v/ere also encountered. The average Iftansaction 
time was rather lengthy, asi long as two and one-hal'f miri\ates . This 



( 

could p(ose serious peak load problems 'for a nationwid'e system 
accessed by numerous . telephoi^e lines. However, there was evidence 
o,f a steep "learning curve"; frequent use of the system quickly 
resulted in average transaction times of one minute or less. 
There was some difficulty in coordinating the study witfr^he 
day-to-day opecati of PAL* Telephone ^Vin^s" were not always 

staffed by operators familiar with the study, so some user ^; 
-questions were not satisfactorily answered. Finally, an inherent 
limitation of the system is that only closed-ended questions 



can be asked. Open-ended comments cannot be 



recorded, 



To make- computerized phone-based systems practical for pretesting. 



qualitative ratings or interactive programs, 
research procedures and system configuration 



several changes in the 
4^sed in the pilot 



test are in order. Most iinportant is the adjjitiOn of portable input 
devices (Section III) that would greatly expaind ,the -potential respon- 
dent pool beyond those who own Touch- tone j^hone^*. This* measure 
would also reduce -the average transaction time by as much as a factor 
of fiyjjje, greatly relieving the peak load problem^'^^d reducing 
coi fc>utj» f^ time charges.* 

^ I) 

\ 
\ 

A user dialogue with improved interactive capabilities should be 
developed that could detect and request correction on the most 
commonly made user errors. ^The system mi^ht even "walk" new 
usersr through questionnaires, although it \^ould not be cost- 
effective to have the computer administer t^e questionnaire in 



regular U3e. 
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Procedures for interac^ng with respondents should also be upgraded. 
A live operator should be on standby to answer questions at all 
hours during which the system is in use. System software should 
be improved to generate real-time monitoring information that could 
be used to identify nonrespondents or those who make frequent 
errors so that follow-up calls could be immediately directed to 
them. An automatic phone dialer capable of -delivering recorded 
messages- 'could be used for these purpose's. 

The capacity o*f the system must also be increased. A n&nber of 
WATS lines and additional "black, boxes" to read the incoming . 



r 



Touch-tones, perhaps 15 to 20 in all, would be needed for a national 
service. A back-Uj^^ystem, perhaps employing telejihone answering^ 
machines to record the Touch-tone impulses, would also be vital. 

While it is easy to envision how to add a capability for recording 

open-ended conunents to the system, it is. not advisable to do so. 

The cost saving realized by-etiminating manual data processing- 

woi\ld soon- evapoijate while transaction times (and hence computer 

\ 

time changes) would skyrocket. A lovv;rcost alternative would be 
to permit usears to offer open-ended comments to. the operator 
standing by to answer" questions Select respondents might be 
invited to make such calls based on their closed-ended responses 
to program content. 



\ 



Finely,' .a -parallel Spanish-speaking system should be implemented. 
Spani'sn-domdnant respondents could be given spegial identification 

./ - - . ■ , 

yfcodea-that would autoraatically route them 'tq a -Spanish-speaking 

softviare package "when they place thei?: calls. ^.P^ 

;• \„ \ • 



59. 



V. THE COST QF AUDIENCE FEEDBACK SYSTEMS ^ 

A critical consideration in tlie application of interactive 
television technologies is their cost to th'e sisrvice user- While 
the technologies may of fer 'distinct advantage^ over conventional 
data collection methods in terms of their functional capabilities,^ 
they wia^l not be a^iopted by public broadcasters unless they offer 
a cost advantage, as well. Choices between the various ' available . 
technologies will also be made on the ba-sis of their relative cost 
effectiveness. The goal 'of tAis section is to examine the issue 
of the cost effectiveness of the'^various interactive technologies 
.both in comparison to conventional methods and in comparison vith 
eSch other. 



\ 



These estimates represent our best judgment of the possible costs. 
In* virtually all cases, it is impossible to calculate cost 
figures with complete confidence and precision, since many of the 
systems have yet to be used in one or more of the applications ^ 
considered in this paper. In other insta||j^, the providers of 
the system have not as yet established a firm price structAire for 
their services. This 'is not surprising since the actual costs 
will in large part depend on factors (fe.g,, response rates, phone 
line charges) that will not be quantifiable until the systems 
have bee'n used a number of times in each application. The inter- 
active technologies also intrc|duce new dimensions to the cost 
equation for research. .Compliter^^conjoeet^T^^^ terminal, in- 
stallation fee^, terminal recovery rates, and an^rix^td: 
schedules for computer hardware are a few »of the factors that 
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\ 



62 ■ ^ 



figure prominently but whose full impact on costs is unknown 

* 

at present. . ^ - 

si / 

Therefore, for estimation purposes,' a number of simplifying 
assumptions are necessary. We will limit our analysis to the 
prototypical examples described earlier- for pretesting, qualita- 
tive ratings, public opinion polling and interactive program- 
ming. We will focus our analyses on the two or three most 



promising technologies for each application. With the exception / 
of interactive programming, we will assume that the systems 
will be operated by research suppliers rather than tjy public 
broadcasting entities as an "in-house**- function. We will use 
prevailing commercial rates for ^ such component costs as sample 
recruitment, keypunching, computer time, live operators, etc. 
In so doing, we may err on the side' of ov^erestimating the actual 
costs, since an- on-going research service should greatly reduce 
such costs by assiaming the functions themselves, thereby realiz- 
ing economies of scale. We will fyrther 'assume a constant 50 percent 
overhead rate on the actual research costs. This r^te is somewhat 
lower, than that prevailing in many commercial research o^rganiza- 
tions. However, it is our assumption that one of the- impacts 

- of the new technology will be. to reduce overhead t)y aut9matii1g 

the res^earch process and reducing recurring personnel overhead 
costs. * ' 

\ ' 

A. Cost Compatrisons for Pretesting ^ V 

\ 

Jn the commercial sector the cost of pretesting a half-hour 
program on a specialized target audience can range f rpm little 
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..^s $17 per head for an audi-torlum test to oyer $100 per head for 

"V, 

foous group interviews. The most relevant comparison is with the 
service ASI provides in which cable viewers' are invited to view 
a pilot and then "are suryeyed the following day via telephone. 
The cost of this, type of''stu|y^is about $20 per head. However, 
it is not exactly compat-abrle €b our prototype example since 
conti|nuous* ^ratings ^are not obtained. If this wete done by con- 
^^ventional means (e.g., by having respondents record ratings >?Ln 
diaries) it woMld probably add $2 to $3 per head for manual 
Tiata 'processing, postage, and follow-ups. 



The* cost effectiveness of audience feedbaqk systems in pretesting 
depends on two factors: the nature of the transaction with the\ 
respondent and the number of te^t sessions for Which' respondents 
remain in the study. There are three different approaches to -the 
respondent dialogue., First, the computer (e.g., tComputafone or 
PAL) actually asks the questions and records replies^ade by 

push-button (PAL) and/or rotary dial (Computafone) impulses. 

♦ - 

A second approach is to h^ve the respondehts record their re-' 
sppnses on-'papfer in advance and enter them manually into the 
vphone all at one time (preceding chapter) . A third possibility 
is to enter the responses off-line into a portable ' terminal 
such as PEAC II or an automatic dialer) ana^then play them back 
into the phone in a short burst. 

... 

The first type of dialogue is probably not cost-effective in 
comparison with conventional techniques. In an hour*s t^((e, 
Computafone could probably complete no mor^^han two such 
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transactions per zel^pi^ne line**, •at. a cost of $5. 55 each for data col 
lection. It. would probably be l^ss expensive to )iave a live Operator 
collect the data, and enter it directly into a computer, which is-' 
hqw many survey research firms presently operate. The potential 
c6st benefits* of Comput^fione in making the initial contact would 
be neutralized, sijice ^we are assuming that , respondents^ would have 



beeti contacted in advance by mai-1 or phone ^nd would thus^ be , 
equally available to either a live or computer operator when 
Called back. , ' 

The same holds, for ^khe second type of dialogue in which users en- ' 
ter their written responses. Howevdr, here a machine could prob- 
ably record a string of numbers with fewer errors more quickly 

^ . « ** 

than. a live operator, so there might be a cost advantage to 

the automated system — perhaps as' much as a 50 percent time savings. 

Either ARS or Computafone^ would be a pos'sibility .in this 

instance since the subjects would have tlie questionnaire in 

advance and would be able' to foilow the much simpler user 

dialogue despite ARS' s l;ieavily computer-accented "voice." If 

w^ assume that each dialo/ue would require the respondent to in- 

put a total of 60 numerical ratings and three short open-ended 

questions, each transaction might take five- minutes for ex- ^ 

perienced, respondents. In an hour's' time, fcomputafone 'could/ 

complete pethaps 300 such calls' at a cost of L$l.©s7 per respondent. 

ARS would be slightly less expensive, with a total cbnnept time 

of 30 hours, costing $600 for 400 call5>, or $1.50 per^ head for 



data collection* After adding the costs of data processing, 
recruiting and overhead, thg per- head costs would be about $16 
for either Computafone or ARS , compared to $18 -for collecting 
the data with ylive operators in this fashion. * 



'V?hen data are collected off-line and played back in a burst, 

' ' , • , 

major cost savings- could be realized over, live operators. How- 
.ever, PEAC II might cost as much as" $30 per head, ciue to its rather 
.^igh installation and terminal coPts. If a much less expensive 
and more portable terminal were usecf (perhaps by adding an 
inexpensive automatic telephone dialer^.^ either ARS or Computafone! 
the costs could drop dramatically. Now, ^ach transaction could 
take 30 seconds or less to' complete-. At that point, the^ dis- 
tinction between the pricing .poli-oie^ ^of ARS and Computafone 
would probably tip the balance in favor of the former. Com-putafone 
charges by t^ hour, including the time it takes to pl^e' a call 
and get in touch with the designated responc^ent. Shi/ could add 
perhaps 90 seconds to the average call,. With ARS, the clo^lS^tarts 
running-^.ohly ^fter the call is placed. With ARS,^ the data col- 

•lection*'costs v/ould be only about 16 cents p^r head, compart with 

^ > 

perhaps 40 cents to 50 cents per qall for Compjajb^f one . ' Even after 

adding the cost of an additional WATS line and -a live operator to 

• . , . ' n . 

the ARS cost (necessary*^o implement the collection of open-ended 
questions) , tHe per-head cost for da^ta collection would still be 
considerably less. APL could cost even less with its* projected 
cost of 10 cents pe'r transaction. However, this does hot include 
the Oast of ^adding WATS lines and 'Sidditionar computer hardware 
for the *fast turnaround data analysis needed for pretesting . ^ 
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Of. course, the additional cost -of' the telephone dialer must be 



addeA to such a system. A related i^sue is the dialers' du3;ability 
and the rate at which panelists will return them once a study is 
completed. 'Both factors are unknown at present; .However, even, 
if a relatively large number of terminals ^were destroyed or Ibst, 
say as many as '50 percent, such systems would still be cost- - 

effective given a high enough number of repeated uses through 
the trade-off of computer connect time against terminal costs. Under 
the worst case (50 percent terminal mortalities) , a repeat panel 
involving five tests woulcj be necessary ,to equal the per-head cost 
of conventional data collection. ^ Under the most favor/able 
^nditians, with up to 80 percent returned, the break /even point 
would be as few as three repeat uses. If the terminal stayed, 
in the -home for as mariy'as 20 tests, .the per'he^^4<^cc^3ts could 
drop to well under $10. * - 




At this juncture, there ax:^ a number of crucial, unanswer-ed 

questions bearing on the potential- cost effectiveness of inter- 

active techiiologies for. pretesting. If termi^faiLs are used, 

the costs of replacement and maintenance are (^^ij^ic^l unknowns. 

As in oihej^ applications, thfere is also the c^estion of the^^ 

response rate that >will be obtained using th^Lse technologies. 

. . • / ' 

A pilot study (Chapter XV) found low overall response rates, 

^ »^ / ' 

although among a population known for. characteristically low 
r^es of response. The'€rue response ra 



t4 will hav( 



have a major 

bearing on the cost ef f ectiveliess of* th^se technologies,^ es- 
pecially in vie\^ of the fact that they/must be embe(3ded ^in a 
panel study to be cost-effective. 
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It -is even possible that, in time, the response rates might be 
considerably higher than thosl^ observed with conventional 
methods. Efficient/ real-time monitoring of incoming "dajra may 



m 



ake highly targeted, tiighly cost-effective follow-up procedures 



possible that will boost return rates at a low marginal cost.^ 
Sysiems like PeXC II and ARS in which the respondent initiates' 
the call may prove mor^ convenient for re^spondents than con- 
ventional phone interviews. 

It ap^^ears that Computafone or ARS coulcJ be cost-advantageous 
compared to conventional pretesting -techniques if ^used in. a 
mode where a panel of respondents enters a string Qf ratings 
without lengthy intervention by ^a live operator or without • 
e*xtensive prompting by thje comp'uter. However /-only time will > 
t'ell if the assumptions vj^^^h^e made .about t1ie' response rates 
and^ productivity of ,these"^systems will be real'ized. 
provjes feasible and acceptable to maintain panels over a^rela--' 
tively large number of tests, than the ACidio Response Service 
or Computafone, used in conjunction with an automatic phone 
^dialer memory, would have a distinct co^t advantage. It might 
be possible- to halve the ^st of conducting pretests by conven- 
tional means. ^ • \ ^ \ 

PEAC II would not appear to hav4 a cost advantage unless hardware 
ind installation costs come-down or unless an exceptionally 
largfe niiinber pf testSsTe.g., once, a week over a period of years) 
were conducted in each household.- 



\ 
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B> Cost. Comparisons for Qualitative Ratings '* 
The cost of obtaining qualitative ^ratings by conventional means 
(i.e. diaries) is difficult to"* estimate , since only a single ^ 
pilot study df the type of system envisioned in this report has 

' % - r ' ' 

been performed. A conventional viewing diary costs approximately 
$35^ per h§ad, wh'ich would certainly be the lowest possible cost i 
for a, qualitative rating 'diary . - A recent field test of a quali- 
tative tating diary suggests that actual costs may be two to 
three times this amoun^t.. For the sake of argument, we will use 
the figure of $60 per head per sweep for th^ prototype applica- 

tion described earlier in which a sample household would remain 

*, ~ ' 

in the sample for four "i^weeps" during a year. , : 

" Many of the cost considerations p'ertaining to pretesting apply 
equally to qualitative^ rating applications^ In fact, for\the 

C 6. 

present purposes, it is peorhaps best to think of qualitative 

ratings as a kind of diagnostic testing in which respondent are 

empanelled for ^ relatively small number of repeat studies', but 

^ . %. ' 

in which the volume of data "generated by each study is considerably 

lar'aer, e*g^, 2,0'00 columns per sweep for a four-person household. 

Sinc^ the conventional"Tneans of data collection involve' paper-and- 

pencil diaries, the' trade=4^^ shifts to co^iparisons of hardware 

an^ telephone communication costs with manual data processing 

and postage. " 



f ^ 



For example, for a' family of four taking. part in. four qualitative 
rating "sweeps" during the course of a year/ the cost of postage, 
printing and manual data processing could come to approximately 
O $95 for. the entire family. Alternatively, l^^ie same* family 
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could receive nightly calls from Computafone during -which each 
family member (or one family member serving as " secretary ") would 
enter the 'rating data from the preceding day. Assuming that 
each family member v^atches seven programs a day and that ten columns 
would be ne.eded to record each show, this would mean the entry 
of 280 columns of data per call. We estimate/ based on our demon- 
stration pf the PAL ,system (Chapter IV) , that this would take at least 
15 minutes for the average person with a Touch-tone phone, and as 
much as a half-hour for a rotary dial phone. Assuming for the 
moment th^at respondents 'could be motivated to do this ( a hlahly 

<3uestionabl^\ assumption J ) , the average call, across rotary dial 

1 ' * 

and Touch- to liie, would cost about $5 in Computafone time, and 

/ • 

collection ^^larges would be at least $140 for the family of four. 
In addition, there would still be some minimal mail and printing 
'charges invalved, so that each family member could receive an 
individual, diary ; The Audio Response Service, with its higher ' 
per-minute charges, would be even more expensive if tlie data were 
entered manually in' r'eal time. 

However, systems in which data are entered off-line offer some 

-/ 

potential cost advantages* For example, if ARS were used iyi 
conjunction with an automatic phone dialer and if the dialer 
were shared by the en'^lire family of four, the data entry, printing 
and postage charges would combine to- only about $20 for the ^ 
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entire year for the family. This is because a relatively high 
volume of da|a can be played back quickly through the automatic 
dialers, as much a's 200 characters in a minute-long phone call. 
In thi^s application, family members would enter the data in the 
termi^;ial as they watch the program, much as they would use a 
paper-andT-pencil diary. Whether or not this approach would be 
cost-advanta'geous would mostly depend on the amortization of^the 
dialer, its initial cost and the vcluihe of data. 'Assuming an 
initial dialer cost of $80, it would be a break-even proposition ' 
when compared to paper-and-pencil diaries for a family of four.^ 
However, for a single person household, the break-even point would 
be a $40 dialer, since there would be less proportional savings 
in computer connect time^ relative to manual d^ata processing of , ^ 
diaries. Another way to look at it would be 'that half of the 
V' terminals would have^^to be ret^arned at th^ end Of the year to 
make the system cost-effective in single person households. 
Assuming a high return rate- (say 75 percent) and averaging across all^ 
households, we "guesstimate" • a ' per-head cost of $45 per sweep. 

PEAC II is another system that permits of f-lin%^data collection. 
The greater memory capacity of tltis' system (500^ columns vs. 192 
for existing automatic telephone dialers) offers potentially 
greater cpst savings in data transmission.' HoweVer , the cost . 
of the individual terminals and their installation is also much ^ 
^greater. Taking the initial PEAC li cost estimates at fac^ 
value and. assuming Optimal utilization of the system, it wou^d 
cost $30 per night for 16 nights ov^r tne course of the year, 

o , : ' ■ ■ . 7i 
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or at- least $480 to collect data frojn the family of four. In 

a single person household, tiie figure would be atbout $120. Aver-/--^ 
aging across households, this might amount to . a per-head post of. 
as little as $30 per sweep. However, the implementation of-' a . 
truly national qualitative rating service would introdj^ce some 
major additional cost§ not covered in the initial estimates for 

PEAC II. For one thing, WATS lines would have to-be -adde4. £b 

'the system. It is certain tha^t the installation and training 
costs would rise dramatr^ally with a national-level service,' as 
opposed to one based in a single, confined geographical area. 
Moreov^, the initial cost estimates are based on the assumption 
of a hig^ (but. unspecified) number of repeat uses in addition ^ 
to qualilsl^afeve fating sweeps. This might introduqe an unacceptable 
bia? for qualitative rating applications. If utilization had to be 
confined to qualitative ratings, the cost- would be prohibitive. 

Thus, electronic audience feedback system-s do offer some major 
potential cost savings in qualitative rating applications. HoW- , 
'ever, t^e word "potential" must be emphasized since at this 
point, there 'are a number of important , Unanswered questions about 
the response rates, error rates, and hardware costs associated 
with these tec biologies.. ; ■ ■ . f ' 

1 

|. public Opinion Polling Cost Considerations 
^While we do not consider any of the interactive technologies 
suitable 'for public opinion polling at this time,. a few comments. 
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on their potential cost savings are perhaps in order • • The 
most promising technology for such polling is the Computafone 
^system. If the legal problems associated with "junk calling" 
could somehow be resolved, this s^^stem would permit highly cost- 
ef fective^data collection,' The system could possibly complete 
UP to 2*00 ten-minute inlferv^^ws per houf^', at a cost (for data 
collection) of only' $500. -^veij after adding the cost of in- — 
strument development, data analysis and interpretation and 50 percent 
, 6verhead ,~ the per-head -cost could s.tiri be under $8, However, 
it is also possible that the completion rate would be less using 
an automated service than^a live operator (e.g., "I don't talk to 
•computers," click.) If so, the qUallty and cost-effectiveness ^ 
of the results would suffer. . This is an unknown" parameter at 
. this time. ' , f 



D. Cost Comparisons for Interactive" Programming 

I-nteractiVe programming with mass call-ins has'^seT.dom been rtried 
With conventional means. A somewhat analogous application is 
the telethon, a famili,ar phenomenon to**public broadcasters. Public 
broadcasting telethqns are dbne at exceptionally low costs since 
most station? maintain a lar^e number of phone lines throughout 

the ^y'ear ^and use volunteer labor to- staff the phones. The volume 

* ■ • ' * I 

of calls is probably considerably lower than would be observed 

during an interactive program. For comparison 'purposes, we will 
assume that interactive programs could be executed using a large 
number of dedica-ted phone lines (f^^g^ *75J and live operators 
•who would record the "votes" of callers and manually tally them 



73 



so that results would be available" within minutes. Further, we 
will assume that the live operators would be paid at the going 
rate for .phone interviews, or $5 per hour, and would be employed 
for two hours per program or $750 per week. The 75 
phone lines would cost $7, 5 JO per month or $1,875 per week if 
used only once eagh week. We assume that' the sample will be 
preselected through the use of prestamped, preaddressed post ^ 

cards suppl^ied by the audience at no' cost to the station. Pro- 
cessing new apj!>li(^tions would incur a minimal additional cost 
f of perhaps $25 per week. After adding $200 per week for super- 
vision and a ten percent mark-up, we arrive at a cost of $3,135 per 
show. If we assume that each "v9te'* will take 20 seconds to 
register, a bank of 75 phones could' handle, 4,000 calls in a 
20-minute period at a £:ost of about 79 cents per head. The per- 
, head costs would drop^ quickly with more- frequent usage, ir^aking 
better use of the phone lines. If a program were 'represented on 
a daily basis, the costs would drop to ^as little^as 25 cents per head 
* • 
If telephone answering machines were used instead 'of live opera- 
tors, the cost would drop to 15 to 20 cents per head, assuming a 
relatively fast (orle'-year) ^ amortization of the answering • 
machines.. Further saving^ would be realized if stations made 
use of the lines t^ey maintain for fund raising. if the tele- 
phone line costs'are^eliminated in this fashion, per-head costs 
would dip to about 30 cents per head if live operators ^ere used and 
to about 12 cents per hea(3 if a bank of answerincj^machines were used. 
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With the parameters of our prototype example; AT&T^s Dial~It 
service would cost about 17 cents per head to the station. Of 
course, it vtould cost the viewer 50 cents for^each use, and it might 
not be politically acceptable (i.e, "elitist") to pass this cost 
of\ to the viewer. The principal costs to a local station, for 

*a weekly^call-in show would b^ one-fiftieth of the $5,000 annual 
subscription fee, $500 for an hour's use of the system in a 

~"'^ngle time zone, a $50 surcharge for minute-by-minute results, 
and about $7 5 per week foiT overhead and processing applications 
from users. The cost to the local station could be reduced 
somewhat if an entity such as CPB were to absorb the $5,000 
yearly fee and reallocate it to' a number of individual stations. 



4 

If a local station were to use the VOTRAK system for a weekly 

t 

-call-in program, the cost per use would be orte-quarter of the 
$6,000 nfonthly lease plus $500 dollars per week for telephone 
lines charges.. Adding overhead and administrative costs would . 
bring the total weekly costs to $2,227, or about 56 cents per head 
Full utilization (i.e., spread acr9ss ten shows per week) could 

9 

dramatically reduce costs to as little as 28 cfents per head. AIL- 

ternatively, a station might make "free" use of the lines it 

: ' ■ J ■ 

keeps on hancT for fund raising, in which case the per-head Cost 

wouljd drop to about the same as Dial-It ""s if the system were 
fuliy utilized.- However, if VOTRAK were to 'be shared by a 
number^of stations in different parts of the country., WATS 
lines would have to be t^ed instead of local lines^ malj;^^ the 
total -'cost prohibitive. What's more, we' are not entirely con- 
fident that the 20 lines recommended would be sufficient. 
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Twenty lines could handle 4,000 cal^ls in a 20-minute period « 
only if the lines were used with peak efficiency and if each 
transaction took no more than six seconds to complete. Even 
with preselectiJon and scheduling of the callers ^ momentary peak 
loads would be bound to exceed the capacity of 2 0 lines. Ten 
additional lines would raise the per--head cost of a weekly shoj/ 
to 84 cents or to 61 cents if "free" phone lines already owned by the' 
station were used, ' j a ^ 

The costs of some interactive systems (e.g., VOXBOX, PEAC II) would 
be clearly ^ohibitive in this application du.e to either excessive 
lines costs or hardware costs.. Since the sample would represent 
'only the viewers of a particular program, it would not be feasible 
to use the sample for other purpose:»-4e-r^, pretesting or qualita- 
tive ratings) . In fact, such a system would only be cost-effective 
if it were part of a multi-purpose, two-way network no^feally dedicated 
to appl\icatioris other than research (e.g., banking, shopping by phone]^ 

T 
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Although not ideally suited for the interactive ^programming appli- 
cations, systems like PAL and the Audio Response Service could 
offer a distinct cost advantage. If the "Audio Response • Service 
were^ used and if each transaction lasted only 15 seconds, 
roughly 17 houts of connect time would be required to process- 
4,0=bo calls at a cost of only $340 ♦ Assuming modest additional 
c6sts for data processing and administration, the cost would fc>e 
only about 1*1 rrents per head. This assumes that SBC would be willing. 
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to add extra lines to their system at little or no additional ^ 

hourly cost. However, even if the hourly cost were doubled,^ 

the per-head cost would rise to only about l^^^cen^^ head. Of 

course, such a .system could be iised--OBiy''^ owners of push-but'ton 

' ' ^4 ' • I ^ ** 

telephones. . . ^ * 



ThuS/ in terms of cost to the station, Dial-It has,_a_clear--cos-t — 

advantage oveT v6TRAK unless a static r*^* s own "pledge lines" were 
used to reduce the cost of the latter. The adaptation of the Audic^;^ 
Response Service or a similar service could substantially reduce 
-the per-head costs. , However, we must also note that while cum- 
bersome, a bank of telephone answering machines (or even a battalion 
of live .operators ! ) migh"t be more cost-effective than any of the 
' technologies best suited for interactive programmirfg applications. 
This is especially, true if the station could make- free use of 
the multiple telephone lines it maintains for annual fund raising. 

/■ ■ ■■ . 

A 'final consideration is the front-end cost^ — the size of the 
"initial investment^ .statiou would have to make tb "buy*- into" 
Interactive television. Of the two leading technologies, Dial-It ^ 
has. a slightly lower initial cost ($5,000 vs. $6,000 for VOTRAK) . 
The Audio Response , Service would have a very modest initial outlay — 
the $100 minimum charge for a single month's user Most ' expensive 
would be the purchase of a bank of answer phones. - An initial^ 
invest;ment well in exces's Of $10,000 would 'be required. 
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VI. CONCLUSIOtjS AND RECOMMENDATIONS 

No single audience * feedback system meets the operational re- 
^quirements of pretesting, qualitative'"^tings , public opinion 
polling and interactive programming • » Howe^^, we can 
suggest all^rnatives for each application which offer distinct 
adv anta ges over conven tional methods and their comp eti tors in terms 
of functional capabilities and cost. We must caution the reader 
that .these recommendations are baseli primarily on information ^ 
provided by the suppliers and mark'eters of the technologies. ^ \ 



Operational Evaluations of these systems were not p'ferformed in- 

• / 

all cases. ^ # 



A. Conclusions 

Our cqjiclusion is that interactive' television is now a 
reality • It can be placed in the service of public broad- 
casters throughout the courttry. The advent of widely distributed, 
broadband communications networks still years away — is" not 
a necessary prerequisite. . * ^ 

Audience .feedback systems offer some potential, Significant ad- 
vantages to public broadcasters, particularly in the areas 
of pretesting and interactive programming.* The v^ious inter- » 
activ^e technologies, could allow public' broadcasters to put them- 
selves in touch with' their audiences in ways which were ^hereto- 
fore impossible, ^t*^ a cost that public brDadcasteifs can afford. 



Significant cost advantages might also, be realized i,n qualita- 
tive rating applications. However, "instant" public opinion 
polling is *noti ^feasible at this time. The technologies which 
.have the greatest promise for each application are discussed 
-below. 

1. .Prestesting , . / 

The' use of audience feedback systems for ..pretesting television 
pilots appears most attractive only when viewer responses'^ can 
be "bat'ch loaded" directly into a computer, without live operator 
intervention or extensive ' computer promoting. Computafone is 
potentially superior to conventional methods and its "new 
technology" competitors both in terms of its operational cap- 
abilities and cost. ' The system allows direct input of responses 
from any home phone into a computer. It also has the capabilit 
of recording open-epded comments. Perhaps the greatest cost 
savings are- realized by the automated call-back capability th 
system possesses. However, the impact o£ this capability i 
limited isy laws against automatic calling, which require t^t 
respondents be initi>ally contacted' by ^mail or live phone /nter- 
views.. The Service Bureau -Corporation 's Audio Response^ervice^ 
is another alternative; although live operators would |/ave to.be 
added to the existi.ng configuration to permit . collectiofft 
of open-ended re^onses^, and it is limited to'homes' with Touch- 
tone phones. ARS is the only system sjuiltable- for pretesting 
that is currently available-^to local stUtions across the nation. 
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•Both Comput^afone and ARS become especially attractive when used 
^ in cbnjunction with simple off-line storage devices. In a 
Xo'ng-terfn' panel study, the costs of pretesting could fall to 
under $10 per head., less than half the curren^t rate for con- 
ventional methods. Either system offers data collection from 
the natural viewing^ environment with unprecedented speed, 
i^lthough less •attractive in terms of cost*, PEAC II is the one 
technology on the^ horizon which can most readily collect con- 
tinuous responses to a ptogram in progress. 

2. Qua]^itative Ratings 

As with pretesting, substantial cost' savijigs might.be reali^^ed 
by using ^he new technologies over conventional (diary) tech- 
niques through reduc^tions in labor, postage and manual data 
processing. However, this savings would only apply if telephone- 
based multiple response systems such as Computafone or ARS are 
, used in conjunction with off-line storage devices? PEAC II would 

• have a relative advantage in^ the amount of data it* -can store, but 
•would be cc^st- advantageous only if, the costs pf home terminal 

installation and user training could be amortized over a large 

number of other /{e . g.^, pretesting, marketing) studies. 

^ - * '""^ 

• ^ ■» ^ 

• 3. Public Opinion Polling ' » * 

' ' ' 1 . 

Primarily because of their failur^^^.to meet the rigorous sampling,, 
requirements of ^public opinion polling, we do ncit believe any 
of the existing technologies -could replace live telephone inter- 
viewers for this purpose. The possible exception is Computafone, 

■ ' ■ ■ ■ ' ■ \ ■ 
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should the legal problems relating to "junk calling" be resolved* 

4 , x^teractive^"prT:ygramming 

If restrict^ed to audience participation formats ,(as opposed to 
those requiring a^ representative sample), audience feedback. ^ 
systems have much to offer in interactive programming applica- 
tions. The most cost-effective alternative of all might be a 
bank of telephone answering devices attached to incoming tele- 
phone lines, especially if the* telephone lines are those which 
a-^tation maintains for pledge and auction purposes - "However, ^ ^ 
this would be a rather cumbersome procedure, and it requires^ a 
prohibitavely large capital outlay ' to purchase the machines. 
AT&T's Dial-It service is also a possible alternati,ve , though y 
the^ biggest drawback to its usage is the 50 cent charge^ tp ea'ch 
caller. In instances in which stations maintain a large number 
of telephone lines, VOTRAK becomes a feasible option. 

5 . User ^ceptance . s ' ^ ^ 

A major uncertainty underlying all the prototype applicatiotis 

discussed here is the level of respondent acceptance of elec- 
/ • » 

tronic audience feedback systems. Our limited experience in- 
dicates that respondents are willing to participate ,in research 
activities ^utilizing these technologies and use them with a high 
' degree of accuracy. However, additional research must' be under- 
taken to furtTier analyze this question.. Investigations of me- 

thods of increasing response ^ates ihcluding real-time moni- 
' ' ' - - ^ 

tdring of incoming .data and highly targeted folld,w-up activities, 
* ' ' f • ' 

are a top priority. , - ' ^ , 



'Recommendations ^ ' , " 

In broad perspective, we recommend that public broadd^sting in 
general and the .Corporation fQr Public Broadcasting?- in par- 
^i(Eular move to take advantage, of the unique potential offered 

♦ 

by emerging audience feedback technologies • At the same time, 
we must stress the Vord "emerging cautioning us that^the time 
is right for further exploration of the various systems, rather 
than a major coinmitinent to- anyione of ^ them for t^e present • We 
believe that CPB can play an important irole in .supporting the 
agikritationj of the various technolbgies to the ^'specif ic needs ' 



of local staticns and educating^ them as potential users • 
We recommend,^ the following specific steps: 

1.. Cpfitinue to monitor the development of the more promising 
technologies described in this report. A simple first step wou 

( f ^ 

be for CPB to follow-up on our initial contacts, placing them- 
selves and i^iterested local stations on the- mall,ing .i^ists of 
serrvices like Computaf one , \ARS , and PEAC. 

2. Subsidize further demonstration projects, such as pur PAL 
study, involving local stations and locals research providers 
which -would apply services (e.g^. , PAL, PEAC II, Computafone, 
QUBE) that are currently available only on a local basis but 
that may someday be available nationally. Por compar,ison 
"^purposes, thfe demonstrations should be designed to meet common 
specifications, such as the ones c(5ntained* in the '"prototype 
applications'*, in Sel&tion II. ~ /. . 



3. Mount an educational campaign designed to promote the use of 
'the two systems currently readily available on a national basis j 
Di^lrlt.* (f of interactive programming) and ARS (for pretesting) 
CPB might support these applications by^ such actions as absorbing 
Dial-rlt's $5 , 000* Annual fee orr by subsidizing the design of 
standard questionnaires and- sampling procedures for ARS. 

4. Since the use of -simple^ of f-line datastorage crevices is 

> . • / * ... . ' ' ^ ' ' 

critical tc\he cost effectiveness of maay systems across. uses, ^ 

CPB should fund a pilot test of these^'devices in either 

*a pretesting o"r qualitative rating application. The" pij-ot • 

•t.est should provide .information abq^t user accepta^e, response* 

* " ' * c ' * 

rates and terminal return rates, * ^ ^ 

5. Interactive programming is a ^ndamentally >new cdnc^pt: for* 
whicn the keyvteo acceptance will be the creative opportunities 
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perceived^ by the programmer rather than the cost, .ef fecf iveness or 
relative ^^advantage ef the technology itsel£/; To^promote. inter- 
active '\eie vis ion asva creative^ ''-plaything/'^ it might be helpful' 
to encourage, its expl®ration a, single station across a 

' / - / ^ V ' . , ^ . .* 

wide variety, of programs, perhaps irt conjunction with thft Program 
Fund, In this case, VOTRAK, rather than *DiaL-It , would b^-'\the 
preferrVd alternative based. oh cost 'effectiveness, if the 
'Station's unused. p3?edge lines w^re used-. \ [ ' ■ / " 
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APPENDIX- 



^AUD 




E FEEDBACK SYSTEMS 



Telejphone-Ba^ed Si^igle Respbnse^Sys terns 
Dial-It' 



vcJtrak 



AineVicanwfl?elephone & Telegraph Company 
(contact "local telephone company) 

Unlijuited- Television, Inc • 
324 East 35th Street 
New York, NY 10016 
(212)" 725-5546 



Telephone-Based Multiple Response Systems 



PEAC 



Computaf one 

The Coitoiunicator 



•Audio Response Service' 



R.D. Percy. & Company 
,3712. Bank of California Center 
900 Fourth Avenue 
Seattle*/ WA 98164 
(2^6) 622-4755 

PEAC Developments 
7 6 Ferris Rpad 
Toronto 

Ontario M4B 164 ' c ■ 
CANADA 

(416) 968-3679 , - 

Media Seryice Measurements 
324 East 35th Street ' • 

^ New York, NY 10016 
(212) 725-5546 

Information Tech^olog.y 
4955 E"*.- Anderson - ' . , 
^ i -Fresno," CA 93727 
' • : (203) 255-8600 

•'^he Service Bureau company 
500 West New England' Avenue . ' 
Greefjv;rich," CT 068'30 

y ; 

Consumers \ Computer fcorp. of Ameiiica 
6815 Convoy Court ^ p ^' 1 
San Die§o, CA" «ra21H\ - - - 

(714y 571;-5610 , ^ 



CES 



< A 



Communications Electronics 

Specialities , Inc. 
260 West New England Av^j jjie 
Winter Park, FL 32789 
(305) 645-04t4 * 



Soft touch 
Porta Touch 



Buscom Systems, Inc. 
4700 Patrick Jienry Drive 
Santa Clara, CA 95050 
(«00) 538-8086 ^ * 



Digitelle 



Digitelle ' 
21 Dixon* Avenue 
Copiague^ 'NY . 11726 
- (516V 842-T8885 
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